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ABSTRACT 
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1.  INTRODUCTION 


1.1.  Definition  of  an  Integral  Manifold 

The  concept  of  the  manifold  has  been  used  as  first  integrals  for  classical  Hamiltonian  sys¬ 
tems  from  1700-1800.  In  the  context  of  this  thesis,  as  a  decomposition  tool,  the  ideas  ori¬ 
ginated  from  [l— 5].  A  definition  of  an  integral  manifold  is  now  given. 

For  the  following  system  of  differential  equations. 

x  =  f  (x  .  y  .t  )  (1.1.1) 

y  =  g  (x  .  y  .  t  )  (1.1.2) 

where  x  ,  y  €R  '  and  t  £R 

a  set  M  CRn x Rm x R  is  said  to  be  an  integral  manifold  for  (1.1.1 )— ( 1.1.2)  if  for 
U0  •  -vo  • c  M- lhe  solution  (x  (t )  ,y  (t  )  ,t  )|x(  }  =  v(f  }  _  is  in  M  for  all  t  €  R. 

In  other  words. 

y  -hix  ,t)  (1.1.3) 

is  an  integral  manifold  for  (1.1.1 )-( 1.1.2)  if  given  the  initial  conditions  (x(r0)  ,y(f0),t0) 

that  satisfy 

y  (t  0)  =  h  (x  (t  0)  ,  1 0) 

we  have  (1.1.3)  hold  for  all  t  €  R  .  The  flow  on  this  manifold  is  governed  by  the  n- 
dimensional  system 

x  =  f  (x  .  h(x  ,t)  ,t).  (1.1.4) 

Note  from  (1.1.4)  that  we  are  dealing  with  an  n-th  order  differential  equation  rather  than  the 

(n+m)-th  one  in  the  original  system  (1.1.1 )-( 1.1.2). 

Some  of  the  advantages  of  using  the  integral  manifolds  in  systems  and  control  are  as  fol¬ 
lows: 

(i)  reduction  of  computational  complexity  due  to  system  order  reduction. 

(ii)  accounting  for  the  intrinsic  slow  effect  of  parasitics  in  singularly  perturbed  systems  by 
treating  the  parasitics  state  y  as  y  =  h  (x  ,c  ,e),  a  function  of  other  state  x,  perturbation 


parameter  e  .  and  possibly  time  variable  t. 

(in)  an  analysis  tool  to  understand  some  known  phenomena,  e.  g..  unsatisfactory  performance 
of  ilexible  robots  in  high-frequency  maneuvers  and  minimum  fuel  paths  in  long-rar.ge  cruises. 

Applications  of  the  integral  manifold  theory  abound  in  many  areas.  Some  of  its  applica¬ 
tions  are  flexible  joint  robot  control  [6],  slow  adaptation  in  adaptive  control  [7],  tracking  and 
disturbance  rejection  in  nonlinear  systems  [8].  power  system  modeling  [9],  and  synchronous 
machine  modeling  [10], 

Mathematical  treatment  of  the  integral  manifold  theory,  as  in  [  1 1  ],  sometimes  is  too  res¬ 
tricted  in  relevant  control  problems.  On  the  other  hand,  there  are  many  special  features  in 
specific  control  problems  that  can  be  of  great  use  when  the  manifold  approach  is  being 
employed.  It  is  this  gap  that  we  want  to  fill  in  this  thesis. 

A  summary  of  the  research  being  done  in  this  thesis  is  as  follows. 

•  Existence  of  integral  manifolds  in  the  linear  system:  an  integral  manifold  in  the  form  of 
invariant  subspace,  z  -  Lx  .  is  postulated  for  the  linear  system: 

x  x 

=  .4  (1.1.5) 

Under  some  assumptions  on  the  A,  entries  of  the  matrix  A  the  existence  of  such  a  manifold  is 
guaranteed.  Necessary  and  sufficient  conditions  for  z  =  Lx  to  be  a  linear  integral  manifold  for 
the  linear  system  are  also  given  in  terms  of  an  identity  relating  L  to  the  A  entries.  An 
explicit  expression  for  one  such  L  is  found  and  represented  by  the  slow'  eigenspace  of  the  sys¬ 
tem  matrix  A.  Once  the  existence  of  the  linear  integral  manifold  for  (1.1.5)  is  assured,  we 
proved  that  there  also  exists  a  shifted  manifold  r  =  Lx  +  p  (u  )  for  the  system  with  input  u.  i. 
e.. 

x 

=  .4  +  Bu 

*-  . 

In  other  words,  there  exists  a  family  of  input  dependent  shifted  manifolds.  Singularly  per- 


turbed  systems  are  treated  as  a  special  case,  and  explicit  expressions  are  found  for  L  and  p  as 
asymptotic  series  in  €  ,  Linear  time-varying  systems  are  also  discussed  as  an  extension  to  the 
linear  time  invariant  case  with  some  extra  conditions  imposed  on  the  AtJ  it  )  entries. 

•  Flexible  link  manipulators:  Modeling  flexible  link  robots  leads  us  to  a  singularly  perturbed 
system  in  which  the  perturbation  parameter  is  related  to  the  reciprocal  of  the  flexibility  con¬ 
stant.  We  interpret  the  presence  of  flexibility  in  the  robots  as  a  cause  for  phase  delay  in  its 
performance,  especially  at  "high  frequency  maneuvers.  Time  domain  analysis  using  the  mani¬ 
fold  approach  leads  us  to  a  phase  delay  corrective  scheme  equivalent  to  that  from  the  fre¬ 
quency  domain  analysis.  A  case  study  of  an  interconnected  mechanical  system,  which  shares 
the  same  basic  principle  in  the  modeling  of  flexible  joint  robot  as  in  [6],  reveals  the  fact  that 
the  overall  system  has  a  perturbed  natural  frequency  and  a  perturbed  damping  ratio  due  to 
the  presence  of  flexibility  in  the  interconnection. 

•  Tracking  and  disturbance  rejection  in  nonlinear  systems:  For  a  class  of  linear  equivalent 
nonlinear  system  with  nonlinear  output,  we  designed  a  controller  that  not  only  linearizes  and 
stabilizes  the  nonlinear  system  but  also  achieves  tracking  and  disturbance  rejection  of  unk¬ 
nown  but  slowly  varying  signals. 

•  Optimal  control  systems:  We  proved  the  unique  existence  of  a  lower  order  optimal  control 
problem  that  is  equivalent  to  a  singularly  perturbed  linear  system  with  a  quadratic  cost  func¬ 
tional  to  be  minimized.  The  trajectory  of  the  singularly  perturbed  optimal  system  is  charac¬ 
terized  by  a  fast  convergence,  with  O  (e)  cost,  to  a  manifold  to  which  the  subsequent  motion  is 
restricted.  Complete  separation  of  a  singularly  perturbed  optimal  system  into  two  is  also 
given.  One  of  these  corresponds  to  the  optimal  problem  as  restricted  to  the  manifold,  whereas 
the  other  one  is  an  optimal  problem  concerning  the  convergence  of  the  trajectory  to  the  mani- 


1.2.  Existence  of  Integral  Manifolds 


(a)  We  are  mainly  interested  in  the  singularly  perturbed  system 


x  =  /  (x  ,y  ,  t  .  €  ) 

(1.2.1. a) 

€>;  =  g(*  ■  y  •  e ) 

(1.2.1 .b) 

where  x  €  R  ‘  . 

m  dx 

v  €  R  .  t  €R  .and  6  is  small  positive  number,  x  =  —  etc., 

dt 

Conditions  for  the  existence  of  an  integral  manifold  .  v  =  h(x  ,t  ,  e)  .  for  system-  (1.2.1)  are 
the  following[l ]. 

Ml:  Setting  g  (x  .  v  .  t  ,  0)  =  0  gives  the  isolated  solution  y  =  h°  (x  .  t  )  for  .v  €  R"  .t  €  R 


M2:  Functions  f.  g  and  h  '  are  all  C~  functions  for 

x  €  R  ”  .  I  y  —  h  5(x  )  I  ^  p  ,  t  6  R  .  and  0  ^  e  ^  €,,  .  where  p  and  e0  are  some  positive 
nonzero  numbers. 

6g  .i 

M3:  All  the  eigenvalues  of  —  evaluated  at  Lx  .  k '  (x  t  )  .  t  .0)  have  negative  real  parts. 


Comments:  M3  is  a  necessary  and  sufficient  condition  for  trajectories  with  initial  condi¬ 
tions  not  on  the  integral  manifold  to  converge  to  the  manifold  asymptotically.  It  is  a  local 
result  and  is  applicable  to  those  trajectories  with  initial  conditions  within  the  region  of  attrac¬ 
tion  of  the  manifold.  We  will  therefore  refer  to  the  integral  manifolds  of  the  systems  satisfv- 

dg 

mg  M3  as  "attractive."  Condition  M3  can  be  relaxed  to  onlv  requiring  that  the  Jacobian  — 

<3.v 

be  nonsingular.  Detailed  proof  can  be  found  in  [  1 1  ]. 


(b)  For  the  periodic  nonlinear  system 


5 


=  X (x  .  v  . t  ) 

=  l'(x  .v  .  t  ) 


(1.2. 2. a) 

(1.2. 2. b) 


where  x  €  f?  ,  y  €  R’r'  .  t  €R  ,  and 


X  (x  .  y  ,t  +  oj)  =  X  (x  .  y  ,  t  ) 

1'  (x  .  y  .  t  +  o>)  =  Y  (x  ,  v  .  r  ) 

there  exists  a  bounded  periodic  integral  manifold  y  =  g  (x  ,t)  for  (1.2.2), 

i  e  .  ||  g  (x  .  t  )  ||  ^  K  and  g  (x  .  t  +<a)  =  g  (x  .  t  )  .  if 

(i)  X  and  V  are  continuous  and  have  continuous  and  bounded  partial  derivatives  with  respect 
to  x  and  y  for  all  x  and  t.  and  for  ||  y  ||  ^  K  where  ||  .  ||  denotes  the  Euclidean  norm  and  K  is 
a  positive  number. 

d 

(ii)  — |[y  ||  <  0  .  for  all  x  and  t.  and  ||y  ||  =  K  .  ie  ||y  ||  ^  K  .  for  all  x  and  t. 
dt 

( iii)  Let 


t)  =  - 

a* 

2 

a* 

a* 

r 

1 

f  )=  - 

l«f+ 

a*' 

2 

a>- 

where  V'(x  ,  y  .  t  )  has  eigenvalues  \k  (x  .  y  .  t  )  ,  1  <  k  ^  n  .  and  W  (x  ,y  , ; )  has  eigen- 
values  fj. .  (x  ,  v  ,  t  )  ,  1  ^  j  ^  m  ;  -  denotes  the  partial  derivatives  of  X  with  respect  to  x 

a * 

and  A  T  denotes  the  transpose  of  A. 

Also  let 


Max. 

M  =  .  i  M , 

J  1 


\  and  /a  have  the  properties  that 


\  ^  //  and  fi  <  0. 


J 

$ 

$ 

i 

j* 

t 

i 

I 

i 

& 

a 

i 

* 

K 

8 

V 


^  here 

II— II  <  «  ■  II— II  «  0  . 

By  Bx 

Proof  can  be  found  in  [5]. 

(c)  Center  manifolds 
For  the  following  autonomous  system 

x  =  Ax  +  f  (.r  .  y  )  (1.2. 3. a) 

y  =  By  +g(x  .y)  (1.2. 3. b) 

'A  here  x  €R  '  .  v  6  R  "  . 

y  =  h  [x  )  is  a  center  manifold  to  (1.2.3)  if  h  is  smooth,  h  (0)  =  0  .  and  h  (0)  =  0  . 

Conditions  for  the  existence  of  center  manifolds  are  the  following: 

( i)  f  €  C2  .  g  6  C2  and  /  (0 . 0)  =  /  (0 . 0)  =  0  .  g  (0 . 0)  =  g(  0 . 0)  =  0  . 

(  n )  Re(X,  (/l  ))  <  0  .  1  <  i  ^  n  .  i.  e.,  all  the  eigenvalues  of  A  have  negative  real  parts. 

Oii)  Re(\;  (B  ))  =  0  .  1  ^  j  ^  m  . 

If  (1.2.3)  satisfies  (i)-(iii).  then  there  exists  a  center  manifold 

v  =  h  !.v  )  for  | x  j  <  5  ,  h  €  C*  .  and  t  €  R  . 

Proof  is  based  on  the  contraction  mapping  principle.  Details  can  be  found  in  [2]. 
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2.  INTEGRAL  MANIFOLDS  IN  LINEAR  SYSTEMS 


2.1.  Introduction 


Linear  systems  are  special  cases  of  nonlinear  systems.  In  our  investigation  on  integral 


manifolds,  all  the  results  from  nonlinear  systems  are  applicable  in  linear  cases.  Due  to  its 


linear  structure,  the  application  of  superposition  and  Laplace  transform  are  made  possible.  It 


is  through  this  that  we  gain  insights  into  the  geometry  and  analysis  of  integral  manifolds  in 


the  control  theorv.  For  the  ease  of  illustration,  we  will  concentrate  on  linear  time-invariant 


systems  and  treat  time-varying  systems  as  an  extension  of  the  time-invariant  cases. 


2.2.  Existence  of  Linear  Integral  Manifolds  in  Linear  Systems 


Start  with  the  following  linear  time-invariant  system: 


\A  11  ^  12  I  lx 


[A  21  A  22  I  U  , 


(2.2.1) 


where  x  ZRn  .  :  €£'"  ,AuZRnxn  .An€Rnxm  .An€Rmxn  .and  A22SRmxm  are  constant 


matrices  . 


Assumption  2.2.1:  .4  22  is  nonsingular. 


Due  to  the  linearity  of  (2.2.1).  we  shall  propose  a  linear  integral  manifold  of  the  form 


z  =  Lx 


(2.2.2) 


where  I.  €R”"''  is  a  constant  matrix. 


Lemma  2.2.1 


For  r  =  Lx  to  represent  a  linear  integral  manifold  for  the  linear  system  (2.2.1).  it  is 


necessary  and  sufficient  for  L  to  satisfy  the  following  identity. 


.4  2i  +  A  22L  —  L  (A  n  +  A  l2L  ) 


(2.2.3) 


Proof: 


Differentiate  both  sides  of  (2.2.2). 


» 


\r 

i 

:3 


:s 


r 


?3 


I 


I 

i 


i 


i  =  Lx 


(2.2.4) 


Since  (.v  .  z  )  is  governed  by  (2.2.1).  we  have  upon  substituting  (2.2.1)  and  (2.2.2)  into  (2.2.4) 

( A  :i+-4  22L  )x  =  L(An  +  A  l2l  lx  ,  (2.2.5) 

which  results  in  the  identity  (2.2.3)  and  completes  our  proof  on  the  necessity  part.  The 

sufficiency  part  follows  in  the  reverse  order  trivially  by  noting  that  the  invariant  subspace 

z  =  Lx  is  one  of  the  integral  manifolds  subject  to  (2.2.1). 


The  main  requirement  for  the  existence  of  a  solution  L  to  (2.2.3)  is  Assumption  2.2.1. 
Details  can  be  found  in  [12]. 

When  our  linear  system  is  in  singularly  perturbed  form  we  have  the  following  result  based  on 
a  similar  argument. 

Corollary  2.2.1 

The  singularly  perturbed  system 


\A  n  A  12  I  [X1 


[A  2i  A  22  1  12  I 


(2.2.6) 


where  e€[  —  €  ,  €  ]  ,  e  >Oisa  small  positive  number,  has  a  linear  integral  manifold  z  =  Lx 


and  L  satisfies 


Moreover.  L  can  be  solved  as 


Proof: 


.4  2i  +  -4  22L  -  €/,  (A  u  +  A  l2L  ) 


L  =  —A  22  A  2I+0  (e) 


(2.2.7) 


(2.2.8) 


Solution  of  L  can  be  found  by  equating  coefficients  of  different  powers  of  €  on  both  sides 


?f  (2.2.7). 


Note  with  assumption  1  our  singularly  perturbed  system  (2.2.6)  exhibits  a  two-time  scale 
property  due  to  a  clear  separation  of  eigenvalues  into  two  groups,  small  and  large,  respec- 


mmmm 


rvl.  *i K3  ft?;*  vfcSc 
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lively.  To  facilitate  our  discussion  on  the  more  general  system  (2.2.1).  we  adopt  the  following 
assumption. 

Assumption  2.2.2: 

System  (2.2.1)  possesses  n  relatively  small  and  m  relatively  large  eigenvalues  . 

In  this  context,  without  loss  of  generality,  we  shall  refer  to  x  as  the  "slow"  mode  and  z  as  the 
"fast"  mode  in  the  subsequent  discussion.  The  existence  of  a  solution  to  (2.2.3)  is  guaranteed 
through  Assumption  2.2.1.  and  some  bounds  on  the  A  entries  which  in  turns  are  related  to 
Assumption  2 .2 .2[  12].  We  thus  have  a  linear'integral  manifold  for  system  (2.2.1).  When  sys¬ 
tem  (2.2.1)  is  restricted  to  the  invariant  subspace  characterized  by  z  -Lx  .  the  slow  variable 


(2.2.9) 


is  governed  by 

x  =  (A  jj  +  A  l2L  )x  =  Asx 

We  now  state  a  fact  on  how  L  is  expressed  in  terms  of  the  slow  eigenspace  of  (2.2.1). 

Lemma  2.2.2 


V  l 

If  vs  =  is  a  slow  eigenspace  for  (2.2.1)  and  Vj  is  nonsingular,  where 

v  2 

v’ !  £Rn'r‘  .  v,€  R'"'n  .  then  L  =  v2v,-1.  is  one  of  the  solutions  to  (2.2.3)  subject  to  the  linear 
system  (2.2.1).  Moreover  L  is  independent  of  the  basis  chosen  for  the  slow  eigenspace  vs  . 


Proof: 


We  will  show  that  (2.2.3)  is  equivalent  to  the  following: 


L  -I 


A  11  A  12  j 

n 

Ay]  Ay  y  L 


(2.2.10) 


where  /,  QRnxn  ,  /,„  are  identity  matrices. 

Expand  (2.2.10)  by  multiplying  out  the  matrices  and  using  (2.2.3).  we  get 


L  ( A  ^  +  A  y>L  )  —  ( A  jj  +■  A  22 L  )  —  0  . 


h 


thus  verifying  (2.2.10). 


v  j 

Suppose  v(  =  is  a  slow  eigenspace  for  (2.2.1).  Multiply  r,  on  both  sides  of  (2.2.10)  and 


■near”-" 
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take  L  =  v2v  j 


-l 


An 

A  12 

4 

A 

vi  = 

rn 

A  21 

A  22 

L 

(2.2.11) 


Since  vs  is  a  slow  eigenspace  of  (2.2.1).  we  have 


r  (2.2.12) 

where  As  is  a  diagonal  matrix  which  contains  the  n  small  eigenvalues  of  A  as  its  diagonal  ele¬ 
ments.  In  a  more  general  sense.  As  can  be  a  matrix  in  Jordan  canonical  form. 

Hence.  (2.2.11)  becomes 


L 


|AS  = 


-i  , 

V2V1  “4 


A,  =  (v  2V  J  4  J  —  V  2)Aj  =  0  . 


This  proves  that  L  -  v2Vj  1  is  one  of  the  solutions.  To  see  that  L  is  independent  of  the  basis 
of  v.  .  we  take  a  new  basis 


V  yM 

\v2M 


where  M  €/?"'"  and  is  nonsingular. 

v'jv'j  1  =  (v2M  )(Af  1v11)  =  v2v11 

This  completes  our  proof. 

For  linear  time-varying  systems  we  consider 


QED 


=  AU)  I  (2-2.13) 

where  e  is  a  small  number,  and  A  is  the  same  dimension  as  in  (2.2.1). 

Assumption  2.2.3:  In  our  domain  of  interest  D,  A,;  (r  )  are  continuously  differentiable  and 
bounded,  and  A  l2  .  A  21  and  A  22  are  bounded. 


32 


12. 


•3? 
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With  this  assumption  we  are  also  assured  of  the  existence  of  a  linear  integral  manifold  z 


=L(t)  x.  where  Lit)  satisfies 

el  =  .4  21  +  A22L  -  eL  (.4  u  +  A  l2L  )  (2.2.14) 

The  solvability  of  L  in  (2.2.14)  is  guaranteed  by  Assumption  2.2.3.  Detailed  proof  can  be 

found  on  p.  212  of  [  13]. 

Once  the  existence  of  the  integral  manifold  for  our  linear  system  is  assured,  the  question 
regarding  the  existence  of  the  integral  manifold  for  the  same  system  with  input  is  best 
answered  by  the  next  theorem. 

Theorem  2.2.1 

If  a  linear  system  without  input  possesses  a  linear  integral  manifold  M0  .  characterized 
by  z=Lx.  then  for  every  piecewise  continuous  and  Laplace  transformable  input  u  to  the  same 
system  it  has  a  linear  integral  manifold  Mu  characterized  by  2  -Lx  +  p  and  p  satisfies 

P  =  (A  22  —  LA  l2)p  +  (B 2  ~  LB  j)u  .  (2.2.15) 

Proof: 


Solution  to  (2.2. 16. a)  is  given  by 


=  Ait) 


x 

z 


xit) 
2  it  ) 


=  <D(r 


where  <t>(r  .  t ,,)  is  the  state  transition  matrix  and  satisfies 


<i>  =  A  (t  )  <I> 

When  the  linear  system  (2.2. 16. a)  has  an  input,  we  write 


(2.2. 16. a) 


(2.2.16.b) 


=  A(f  ) 


+  Bit  )u(t) 


(2.2.17) 


Recall  that  <1 >0  .  t  „)  is  the  state  transition  matrix  of  (2.2. 16. a),  the  complete  solution  to 


12 


=  00  .  rj 


=  00  .  r0) 


*  o  o) 

-o0) 


+  f  <t>U  ,  t)B  (t)u  (r)d  r 


Define 


(2.2.18) 


VS 


Since 


=  0  ,  we  have 


=  O0  ,r0)  ^ 


(2.2.19) 
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p  =  (-4  22 —LA  12  )p  +  (B  2  —  LB  j  )u  .  p  (t  0)  =  0  . 


Corollary  2.2.2 


The  singularly  perturbed  system 


=  >1(0  +  B  0  )u 

ez  z 


(2.2.22) 


has  a  linear  integral  manifold  z  =  Lx  +  p  ,  where  p  satisfies 


ep  =  (A22~eLAn)p  +  (B2  —  eLB  x)u  (2.2.23) 

Furthermore,  a  steady  state  solution  of  p  to  (2.2.23)  can  be  solved  algebraically  to  any  order 


.of  e  provided  the  input  u  does  not  contain  any  frequency  that  is  of  an  order  higher  than  1/  e  . 


In  fact. 


p  =  —A  22B  2u  +  0(e) 


Proof: 


To  solve  for  the  steady  state  solution  for  p,  we  treat  both  sides  (2.2.23)  as  an  asymptotic 


series  of  e  and  use  MAE  (Matched  Asymptotic  Expansion). 


P  =  Po  +  *Pi  + 


(2.2.24) 


L  —  L  o  +  eL  1  + 


(2.2.25) 


U  =  U  0  +  eu  !  + 


(2.2.26) 


Collecting  terms  of  6°  on  both  sides  of  (2.2.23), 


0  —  A  ?2 p  o  4*  &  2U  0 


P  o  —  ^  22  ^  2*^  0  =  ^22  ^2^  4*0  (e) 


(2.2.27) 


thus  proving 


p  =  -A  22  B  2u  +  0(e) 


Similarly  for  e1 


Pi i  *4  22P  i  L  qA  12p p  +  B 2u  j  L qB  yii q 
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P 1  22  ^P  o  "*■  L  {rA  12P  o  B  2U  \  "*■  L  0B  ^  0) 

—  .4  [—.4  22  B  2u  0  +  B  0(£  j  —  .4  12A  22B  2)u0  —  B2u  J 

With  the  assumption  that  the  input  does  not  contain  a  frequency  as  high  as  1/  e.  i.  e.. 

I  €  li  0 1  <  1  .  MAE  is  valid  and  we  can  continue  to  look  for  the  steady  state  solution  of  p  up  to 
any  order  of  €  in  this  manner. 

QED 

2.3.  Geometry  of  Integral  Manifolds  and  Its  Relationship  to  Inputs 

The  subspace  c  =  Lx  is  an  integral  manifold  for  the  linear  system  (2.2. 1J  if  the  solution 
(.v  (f ,,)  .  Lx  (r„  ))  lies  on  the  subspace  z=Lx  for  all  t  €R  .  This  defines  a  clear  picture  as  shown 
in  Figure  2-1.  Each  solution  of  the  system  shall  remain  in  this  invariant  subspace  provided  it 
starts  with  its  initial  condition  on  the  manifold.  When  an  input  is  applied  to  (2.2.1),  the  man¬ 
ifold  changes  to  z  -  Lx  +  p  .  where  p  is  related  to  the  input  u  through  the  differential  equa¬ 
tion  (2.2.15).  An  input  usually  consists  of  feedback,  ie  closed-loop  control,  and/or  open-loop 
control.  As  will  be  seen  later  slow  manifolds  are  invariant  towards  fast  feedback.  So  without 
loss  of  generality,  we  shall  consider  feedback  of  slow  modes  only.  Here  slow  modes  are 
understood  to  be  the  state  x. 

When  a  feedback  of  slow  modes  is  applied  to  (2.2.1)  the  overall  closed-loop  system  is 
again  another  linear  system  similar  to  (2.2.1).  Hence  the  resultant  closed-loop  system  has  a 
linear  integral  manifold  for  itself.  The  feedback  has  effectively  shifted  the  original  linear 


JU 
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integral  manifold  to  another  linear  integral  manifold. 

Lemma  2.3.1 

If  the  linear  system  (2.2.1)  has  a  linear  integral  manifoid  z=Lx,  then  the  resultant  system 
with  input  u=Kx  will  have  a  linear  manifold  r  =  (L  +  M )  x  ,  where  M  is  related  to  L  and  K 
through 


BK  +  AM  -  M  (,4S  +  B  XK  +  A  nM  ) 


(2.3.1) 


where 


§ 

£ 

-J 
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^4  —  A  12  —  LA  j2  .  B  —  B  2  —  LB  j 


and  As  =  A  n  +  A  l2L  . 


Proof: 


First  of  all  we  note  that  the  existence  of  an  integral  manifold  for  the  resultant  system 
with  input  is  assured  by  Theorem  2.2.4.  When  an  input  is  applied  to  (2.2.1).  it  is  in  the  form 


X  ^  11  ^  12  X 

Bi 

= 

4*  • 

,Z  A-  21  ^  22  ~ 

b2 

Theorem  2.2.4  io 

x  As  A 12  x 

Bl 

= 

+  , 

p  0  A  \P 

B 

(2.3.2) 


(2.3.3) 


z  =  Lx  +  p  . 

When  u=Kx.  (2.3.3)  becomes  a  closed-loop  system. 


(2.3.4) 


lx  I  \A*  +  BiK  \x 


(2.3.5) 


Ip  I  l  BK  A  I  IP  I 

Equation  (2.3.5)  is  a  linear  system  similar  to  (2.2.1)  and  has  a  manifold  given  by 


p  —  Mx 

where  \1  satisfies  an  equation  similar  to  that  on  L  in  (2.2.3).  i.  e.. 


(2.3.6) 


BK  +  AM  =  M  (A,  +  B^K  +  A  l2M  )  . 


Note  that  M  is  directly  related  to  the  feedback  gain  K  as  seen  from  (2.3.1).  The  overall 
system  with  input  u  -Kx  has  a  shifted  manifold  z  =  (£  +  M  )x  as  shown  in  Figure  2-2. 
When  we  have  open-loop  control  as  the  input  to  our  system  (2.2.1),  the  resultant  system  has  a 
time-varying  shifted  manifold  as  described  by  the  next  Lemma. 

Lemma  2.3.2 


If  the  linear  system  (2.2.1)  has  a  linear  integral  manifold  z=Lx,  then  the  resultant  system 
with  a  continuous  input  u-f(t)  has  an  integral  manifold.  z=Lx+q  .  where  L  is  as  described  by 


|\W*V 


(2.2.3)  and  q  is  related  to  f(t)  through 


9 

a 

rl.n 


$ 

$ 


''M 
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I 
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?  =  Aq  +  Bf  it  ) 


(2.3.7) 


where 


A  A  22  LA  j2  * 


and  B  =  B  2  —  LB  j 


Proof : 


Again  the  existence  of  an  integral  manifold  for  our  linear  system  with  open-loop  control 


is  guaranteed  by  Theorem  2.2.4. 


L4  n  A  12  1  [x  1 


1A2i  A, 


fit). 


(2.3.8) 


By  Theorem  2.2.4  (2.3.8)  has  an  integral  manifold 


:=  Lx  +  q 

where  q  is  related  to  u  through  an  equation  of  the  form  (2.2.15), 


q  =  Aq  +  Bf  it  ) 


When  we  have  both  open-loop  and  closed-loop  control  as  our  input  to  the  linear  system 


(2.2.1).  we  can  use  the  superposition  principle  for  our  system  and  deduce  the  following  result. 


Theorem  2.3.1 


If  the  linear  system  (2.2.1)  has  a  linear  integral  manifold  2  —  Lx  ,  then  there  exists  a 


time-varying  shifted  manifold  :  —  iL  +  M )  x  +  q  for  the  closed-loop  system  with  input 


u  =  f  it  )  +  Kx  where  M  and  q  satisfy  (2.3.1)  and  (2.3.9).  respectively. 


q  =  Aq  +  Bf  it) 


(2.3.9) 


where 


A  =  A  22  -iL  +  MM,,  . 


and  B  =B2  —  (L  +M)BX 
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Proof: 

It  can  be  easily  shown  by  Lemma  2.3.1.  Lemma  2.3.2  and  the  principle  of  superposition. 

QED 

For  linear  time-varying  systems,  we  have  the  same  form  of  manifolds  except  that  L  and 
M  are  functions  of  time.  When  the  system  does  not  start  with  its  initial  condition  on  the  man¬ 
ifold.  there  is  a  deviation  from  the  integral  manifold.  To  investigate  this  situation  we  perform 
an  exact  transformation  on  the  linear  system  by  using  x,  the  slow  mode  and  T)  .  the  deviation 
from  the  manifold  as  the  new  state  space. 

Theorem  2.3.2 

The  linear  svstem 


x 

^12  X 

*il 

— 

+ 

i  ^21 

A  22  1  [z  | 

\B  2  1 

(2.3.10) 


is  equivalent  to 


X  As  A  12  A  12  x  B  l 

p  =  0  A  0  p  +  B  u 


0  0  A 


(2.3.11) 


where 


V  =  -  -  Lx  -  p 

is  the  deviation  from  the  integral  manifold  of  (2.3.10), 
(2.2.3).  ,45  .  .4  and  B  are  as  defined  in  Lemma  2.3.2. 
Proof: 

Substitute  (2.3.12)  into  (2.3.10)  results  in 


x  —  Asx  +  A  12p  +  A  12T)  +  B  jU 
Differentiating  both  sides  of  (2.3.12) 

f)  =  i  —  Lx  —  p 


(2.3.12) 

=  Lx  +  p  .  L  satisfies  the  equation 


(2.3.13) 


3 

fly.?:,: 


mm 


5? 

1 

i 


a 


=  A  2lx  +  .4  22(t)  +  Lx  +  p  )  +  B2u 

—  L  [.4  +  A  l2(r)  +  Lx  +p)  +  Blu]  —  p  . 

With  (2.2.3)  it  simplifies  to 


7)  —  (A  22  ~  LA  12)t)  +  (A  22  ~  LA  j ,)/>  +  (B 2  ~  LB  :)u  —  p 

p  =  (A  22  —  LA  12)/>  +  (B 2  —  LB  ,)«  , 


(2.3.14) 


we  have 


7)  =  (A  22  -  LA  12)t) 

Combining  (2.3.13)-(2.3.15).  we  have  (2.3.11). 


(2.3.15) 


We  see  from  (2.3.11)  that  the  differential  equation  governing  T).  the  deviation  from  the 
manifold,  is  totally  decoupled  from  the  rest  of  the  system.  So  if  we  assume  that  A  is 
Hurwitz.  then  r\  goes  to  zero  asymptotically  and  our  system  will  be  on  the  invariant  subspace 
Mu  .  It  is  in  this  context  that  we  refer  to  the  manifold  Mu  as  an  attractive  manifold. 

Corollary  2.3.1 

If  A  is  Hurwitz  then  the  steady  state  of  (2.3.11)  as  restricted  to  the  manifold  is 
equivalent  to  the  following  system: 


X 

As 

A  12 

X 

By 

p 

— 

0 

A  22 

p 

+ 

B 

(2.3.16) 


For  singularly  perturbed  systems,  we  have  a  similar  result. 
Corollary  2.3.2 


The  singularly  perturbed  system 


X  *11 

A  12  X 

IN 

— 

+ 

ei  A  21 

A  22  1  U-l 

[5,| 

(2.3.17) 


is  equivalent  to 
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A  12 

ep 

= 
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0 

€7) 

0 

0 

A 

ep  =  0  4  0  p  +  B  u  (2.3.18) 

€T)  0  0  4  ^1  0 

where  t)  is  the  fast  deviation  from  the  slow  manifold  rj  =  z  —.Lx  —  p  and  L  satisfies 

.4  21  +  A  2->L  ~  (A  jj  +  4  12L  )  (2.3.19) 

and 

.4  =  .4  22  -  eLA  12  .  B  =  B ,  -  eLB  ,  . 
and  ,4S  =  .4  u  +  .4  12£  . 

Furthermore,  if  .4  is  Hurwitz.  for  €€[0.  €  ]  .  0<<=  « 1  .  ( 2.3.18)  is  equivalent  to 

X  As  A  12  X  B  i 

a  .  +  „  u  (2.3.20) 

ep  0  A  iPl  B 

It  is  observed  from  (2.3.18)  that  rj  is  a  decoupled  fast  subsystem.  We  shall  hereafter  refer  to 

it  as  the  fast  variable.  Now  we  show  that  the  integral  manifold  of  the  linear  system  (2.3.2)  is 

invariant  with  respect  to  the  feedback  of  fast  variable  7} . 

Theorem  2.3.3 

Slew  manifolds  are  invariant  towards  fast  feedback. 

Proof: 

Any  input  to  our  system  must  be  of  the  form 

u  =  Kx  +  /  (r  )  +  G  Tf 

for  some  constant  vector  K  ,  G  and  some  continuous  function  f(t).  We  shall  show  that  the 
linear  system  with  such  an  input. 


X  A  11 

A  12  X 

*i 

— 

+ 

U  , 

(2.3.21)  j 

Z  A  21 

A  22  Z 

b2 

has  an  integral  manifold  z  =  (L  +  M  )x  +  q  regardless  of  the  choices  of  G.  thus  proving  its 
invariance  with  respect  to  the  fast  feedback.  The  variables  L.  M.  and  q  satisfy  (2.2.3),(2.3.1) 
and  (2.3.9).  respectively.  Due  to  its  linearity  we  can  use  the  superposition  principle  to  study 


I 


the  overall  effect  of  different  inputs  to  the  system  (2.3.21).  When  the  slow  feedback  control 
u.  =  A'.x  is  applied  to  (2.3.21).  the  resulting  system  becomes 


Ixl  |.4U+B^  A  12  1  U 


\A21  +  B2K  .4  22 . 


(2.3.22) 


•nj  has  a  linear  integral  manifold  given  by  z  =  (L  +  M  )x  =  Lx  ,  where  M  satisfies  (2.3.1). 


Or  we  can  sav  that  L  satisfies 


.4  21  +  -4  22 L  —  L  (A  jj  +  A  l2L  ) 


When  in  addition  the  fast  feedback 


u  =  G  T\  =  G  (z —Lx —q) 


~  G  -L  I  ]  -Gq 


is  also  applied,  we  have  from  (2.3.22). 


x  x 


1*1  f5il 


:1st  A  -  +  n_  G  -L  1  z  +  B.  i'~Cq) 


A  1 1  B  XGL  -4  12  +  B  jG  x  B  l 

—  -  —  +  (~Gq ) 

.4  t  i  —  B  2GL  A  22  4"  B  2G  z  &  2 


—  A  +  B  (-Gq) 


We  now  show  that 


x  x 

.  G 


has  the  same  linear  integral  manifold  ;  =  Lx  as  in  (2.3.22). 

.4  2!  +A22L  -L(A  jj  +AGl2L) 

=  A2l  -  B2GL  +  (A2  2  +  B2G  )L  -  L[A  u  -BfiL  +  U  12  +  fl  tG  )I  ] 

=  .42j  +  .4  22L  ~  L  (A  n  +  .4  l2L  )  =  0 
bv  (2.3.23). 


(2.3.23) 


(2.3.24) 
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This  completes  our  proof  for  the  case  when  the  input  is  of  the  form  of  a  closed-loop  feedback 
control,  u  =  Kx  +  G  r)  .  Now  for  the  system  with  input  u  =  Kx  +  Gt)  +  /  (r  )  . 


=  A  +  B  (Kx  +  G  7)  +  /  ) 


(2.3.25) 


it  is  equivalent  to 


=  /lG  _  +  B  (/ -Gq) 


(2.3.26) 


by  using  (2.3.24)  and  the  superposition  principle.  Finally  we  show  that  (2.3.26)  has  the  same 
manifold  z  =  Lx  +  q  as  (2.3.25)  does. 

By  using  Lemma  2.3.3  .  (2.3.26)  has  an  integral  manifold  z  =  Lx  +  qc  ,  where  q0  satisfies  the 
following: 

q0  =(A%  ~LAG12)qG  +  (B  2  —  LB , )(  /  —Gq  ) 

=  (A  22  -  LA  n)qG  +  (S2  —  LB  y)Gq  +  (S2-‘L81)(/  —Gq  ) 

=  (A22-LA12)qG  +(B2-LBl)f  (2.3.27) 

By  comparing  (2.3.27)  with  (2.3.7),  it  is  obvious  that  a  solution  to  (2.3.27)  is  given  by 

qc  =  q  ,  which  is  independent  of  the  fast  feedback  gain  G.  Hence.  (2.3.26)  or  (2.3.25)  has  the 

integral  manifold  z  -  Lx  +  q  that  is  independent  of  the  fast  feedback. 


The  above  theorem  enables  us  to  carry  out  the  two-stage  design.  We  can  first  stabilize 
our  fast  subsystem  and  then  concentrate  on  the  slow  subsystem  by  regarding  it  as  subse¬ 
quently  decoupled  from  the  fast  subsystem.  On  the  decoupled  slow  subsystem,  we  can  design 
our  controller  to  achieve  specific  tasks,  e.  g.,  tracking  etc.  The  eigenvalue  placement  problem 
can  be  done  in  two  steps.  Desired  fast  eigenvalues  can  be  obtained  through  fast  feedback  on 
the  fast  subsystem.  We  then  work  on  the  slow  subsystem  to  achieve  our  slow  eigenvalue 
assignment  objective.  When  the  system  does  not  start  on  the  manifold,  and  the  fast  subsystem 
is  not  stable,  this  is  equivalent  to  saying  that  the  slow  manifold  is  repulsive  and  the  solution 
will  not  come  down  to  the  slow  manifold.  We  can  stabilize  our  fast  subsystem  as  shown 
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is  equivalent  to 


+  B{us  +  u;  ) 


(2.3.28) 


X 

A%  A  12  A  12 

X 

B  y{us  +  Uf  ) 

p 

= 

0  A  0 

P 

+ 

Bu5 

V 

0  0  A 

Buf 

where  .4S  ..4  and  B  are  as  defined  in  Lemma  2.3.2.  Take  uf  =  G  rj 
Hurwitz:  (2.3.29)  becomes 


(2.3.29) 

so  that  A  +  BG  is 


X 

A r  A  X2  A  i2  +  B  iG 

X 

P 

= 

0  A  BG 

P 

+ 

B 

V 

0  0  A  +  BG 

0 

(2.3.30) 


When  the  closed-loop  fast  subsystem  is  asymptotically  stable,  the  steady  state  of  the  slow 
subsystem  becomes  the  same  as  the  one  restricted  to  the  manifold,  i.  e.. 


X 

As  A  l2 

I 

X 

*1 

— 

0  ^22. 

+ 

P 

p 

B 

(2.3.31) 


’>  >.•  all  the  previous  results  based  on  systems  that  start  on  the  manifold  can  also  be  applied 
.1  systems  that  do  not  have  their  initial  conditions  on  the  manifold  but  have  subsystems  that 
are  stable  or  can  somehow  be  stabilized  through  fast  feedback. 


2.4.  Frequency  Domain  Interpretation  of  Integral  Manifolds 

When  our  system  starts  on  the  manifold,  it  will  "flow"  along  the  manifold  as  time  goes 
on.  The  motion  on  the  manifold  is  governed  by  a  system  of  differential  equations  that  is  of  a 
lesser  order  than  the  original  system.  It  is  crucial  to  have  the  initial  condition  on  the  manifold 
so  that  we  can  consider  our  system  as  restricted  to  this  invariant  subspace  as  time  progresses. 
For  the  case  when  the  initial  condition  is  not  on  the  manifold,  a  separate  discussion  is  also 


given  in  Section  2.3.  For  now.  we  shall  assume  that  the  initial  condition  is  on  the  manifold. 
We  then  investigate  the  equivalence  of  the  two  designs  from  the  point  of  view  of  frequency 
domain  and  that  of  the  integral  manifolds. 

•  Equivalence  of  the  Two  Designs 

Theorem  2.4.1 

The  integral  manifold  design  is  equivalent  to  the  frequency  domain  analysis. 

Proof: 

When  we  take  the  Laplace  transform  on  both  sides  of  the  linear  system 


^  12  X 

B  i 

_ 

+ 

u  , 

(2.4.1) 

i  ^21 

A22  z 

1*2 

we  have  for  z 

Z  =  (si  —  A  22rx  (A  21X  +  BjJ  +  z  (0))  (2.4.2) 

where  /  is  an  identity  matrix. 

When  (2.4.1)  is  on  the  manifold 

:  =  Lx  +  p  .  (2.4.3) 

we  have 

x  =  (A  u  +  .4  12L  X*  +  A  l2p  +  B  xu  (2.4.4) 

p  =  (^4  -,2  —  LA  i2)p  +  (B2  —  LB  y)u  (2.4.5) 

z  (0)  =  Lx  (0)  +  p  (0)  .  (2.4.6) 

We  now  shew  that  the  integral  manifold  in  the  frequency  domain  is  the  same  as  (2.4.2). 

Rewrite  (2.4.5)  as 

p  =  A  22p  +  B  2u  —L(Al2p  +Sju).  (2.4.7) 

Taking  the  Laplace  transform  on  (2.4.7),  we  have 

P  =  (si  -A22Y\B2U  -  L(Al2P  +  ByU)  +  p(0)J 
Now  we  take  the  Laplace  transform  on  (2.4.4) 


(2.4.8) 


Multiplying  both  sides  by  L  ,  we  have 


[sL  -L{An  +  A  nL  )]X  -  Lx  (0)  =  L  (A  l2P  +  BtU)  .  (2.4.10) 

Using  the  identity  that  L  satisfies,  i.  e., 

L{A  n+  A  l2L  )  =  A  21  +  A  22L  , 

(2.4  10)  becomes 

[( sI-A22)L  —  A  2l]X  —  Lx  (0)  =  L{AUP  +  B  XU  )  .  (2.4.11) 

Substituting  (2.4.11)  into  (2.4.8)  we  have 

P  =  {si  -A22)~lB2U  -  [{si  -A22)L  ~A2x]X  +  Lx  {0)  +  p{0) 

=  (s/  -A22TX[B2U  +  A  21X  +.'(0 )]-LX  .  (2.4.12) 

Take  Laplace  transform  on  our  manifold  expression  (2.4.3)  and  use  (2.4.12) 


Z  =  LX  +  P 

—  LX  +  {si -A  22Y\b 2U  +AnX  +z{0)]-LX 

=  {si  -  A  22Y\B2U  +  A  2xX  +  z  (0)] 
which  is  the  same  expression  as  (2.4.2). 

QED 

The  above  theorem  justifies  the  use  of  the  manifold  approach  in  linear  time-invariant 
systems.  Note  that  we  can  design  our  controller  from  the  point  of  view  of  the  integral  mani¬ 
fold  for  those  nonlinear  systems  which  are  not  Laplace  transformable  and  thus  renders  the 
frequency  domain  analysis  impossible.  The  integral  manifold  design  is  especially  powerful 
when  we  are  dealing  with  singularly  perturbed  systems.  A  controller  in  the  form  of  an 
asymptotic  series  of  e  (the  perturbation  parameter)  can  be  designed  based  on  this  methodology. 
This  will  be  illustrated  in  the  subsequent  Sections. 


2.5.  Eigenvalue  Placement  Problem 

We  consider  the  eigenvalue  assignment  problem  for  linear  time-invariant  systems  that 
contain  slow  and  fast  mode  eigenvalues.  Here  slow  mode  eigenvalues  mean  eigenvalues  with 


CF 


0 


§ 


§ 


smaller  magnitude  as  compared  relatively  with  the  fast  ones  or  the  larger  ones  of  the  same 
system  matrix.  As  will  be  shown  later,  this  can  be  done  in  two  stages.  First  of  all,  slow  mode 
eigenvalues  are  brought  to  the  desired  ones  through  feedback  of  the  slow  variables.  The  fast 
mode  assignment  is  accomplished  by  applying  a  fast  feedback  so  that  the  resultant  fast  sub¬ 
system  possesses  the  desired  fast  mode  eigenvalues.  The  fast  variable  is  the  deviation  from  the 
slow  manifold  which  is  characterized  by  the  slow  eigenspace  of  the  desired  slow  mode  eigen¬ 
values. 


Recall  from  Lemma  2.2.2  that  if  the  linear  system 
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Au 

A  12 

X 

X 

- 

~ 

A  21 

A  22 

z 

=  A 

z 

(2.5.1) 


has  a  linear  integral  manifold  z  =  Lx  ,  then  L  is  given  by 

L  = 


-l 


(2.52) 


where  v.  = 


v-, 


is  the  slow  eigenspace  of  (2.5.1). 


When  we  want  our  system  (2.5.1)  to  possess  the  desired  slow  mode  eigenvalues,  i.  e.. 
\sJ  ),  through  feedback  control,  the  resultant  slow  eigenspace  becomes 


Id 


2d 


(2.5.3) 


Apparently  the  resultant  system  with  feedback  has  a  new  shifted  manifold  given  by 


’2d  V  Id 


-  (2.5.4) 


Lj  =  (L  +  M  )  ■ 

where  \1  satisfies  (2.3.1)  in  Lemma  2.3.1.  Therefore,  assigning  slow  mode  eigenvalues  for  the 
linear  time-invariant  system  is  equivalent  to  requiring  our  closed-loop  system  to  possess  the 
desired  slow  manifold  :  =■  Ldx  .  With  Assumptions  2.2.1  and  2.2.2  we  shall  propose  a 
methodology  for  our  eigenvalue  assignment  problem. 


When  our  linear  system  is  transformed  to  an  equivalent  system  using  x  and  T)  (the  devia¬ 
tion  from  the  slow  manifold  :  =  Lx  )  as  the  state  variables,  the  system  matrix  will  be  in 
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upper  block  triangular  form.  It  is  proved  in  Theorem  2.3.3  that  slow  manifolds  are  invariant 
towards  fast  feedbacks.  In  other  words,  the  fast  eigenspace  (fast  manifold)  T)  is  orthogonal  to 
the  slow  eigenspace  (slow  manifold  characterized  by  z  =  Lx  )  .  Hence,  when  we  adopt  the 
slow  eigenspace  and  the  fast  eigenspace  as  our  coordinates  for  the  linear  system  we  should 
have  a  block  diagonal  matrix  as  our  system  matrix.  We  will  name  the  new  coordinates  as 
p  and  T)  .  respectively.  It  is  due  to  the  block  diagonal  system  matrix  that  we  can  have  the 
two-stage  eigenvalue  assignment  design. 

Recall 


X 

X 

=  A 

z 

2  . 

+  Bu 


(2.5.5) 


is  equivalent  to 


X 

As  A  12 

X 

= 

0  Af 

■h 

r\ 
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B 

(2.5.6) 


where 


As  —  A  j  j  +  .4  \2L  ■  A I  —  .4  22  —  LA  12 
B  =  B2~  LB  j  .  7)  =  j  -  Lx  : 

here.  L  satisfies  (2.2.3).  To  achieve  block  diagonalization  we  have  to  use  p  .  the  invariant  sub¬ 
space  characterized  by  Z  =  LX  .  as  our  new  coordinate  .  The  state  variable  p  is  obtained  by 
removing  the  fast  eigenspace  component  in  x. 

p  =  x  -Hrj. 


where  H  satisfies 


Then  (2.5.6)  becomes 


(.4  u  +  A  12L  )H  +  .4  12  =  H  ( A  22  ~  LA  12)  . 


(2.5.7) 


(2.5.8) 


Equation  (2.5.9)  without  input  is  in  block-diagonal  form.  When  the  system  starts  with  its 
initial  condition  on  the  eigenspace  spanned  by  p  ,  its  motion  will  be  governed  by 
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and  will  remain  in  it  as  time  goes  on.  This  is  exactly  the  description  of  motion  on  the  slow 
manifold  of  the  system.  Hence,  the  slow  manifold  is  the  invariant  subspace  spanned  by  the 
slow  eigenspace  of  the  relevant  system  matrix  .  The  same  argument  applies  to  r)  ,  the  fast 
eigenspace.  and  we  shall  name  it  as  the  fast  manifold  for  the  sake  of  completeness.  By  assum¬ 
ing  the  complete  controllability  of  (2.5.5).  we  also  have  the  complete  controllability  of  the 
slow  and  the  fast  subsystems  in  (2.5.9).  The  complete  controllability  of  the  slow  subsystem 
in  turn  ensures  that  we  can  choose  K  so  that  when 


u  =  K  p  +  u  2 

is  applied  to  the  linear  system,  we  have 


p 

As  +  (Bt-HB)K  0 

P 

B  j  —  HB 

= 

+ 

V 

BK  Af 

V 

B 

(2.5.10) 


where 


+(BX-HB)K\  =  A„  .  :  (2.5.11) 

(  \SI  }  are  the  desired  slow  mode  eigenvalues. 

Since  our  slow  eigenspace  has  been  changed  as  a  result  of  change  of  slow  eigenvalues,  we  have 
a  new  shifted  slow  manifold  or  slow  eigenspace  characterized  by  the  submatrix 


As  )K 

in  (2.5.10). 

Since  we  have  introduced  a  slow  feedback  into  the  fast  subsystem,  the  fast  eigenspace  is  also 
changed  correspondingly.  We  shall  name  the  new  coordinate  spanned  by  the  new  fast  eigen¬ 
space  as  <J  .  where 

cr  =  T)~  N p  .  (2.5.12) 

and  X  satisfies 

BK  +  A;  N  =  N  [A,  +(Bl-HB)K}. 

Note  7}  =  N p  is  a  slow  manifold  within  the  system  (2.5.10)  without  input  u2  ■ 


(2.5.13) 
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With  (2.5.12)-(2.5.13).  we  have  from  (2.5.10) 


[p]  'A,  +  (B1-HB)K  0 


B  j  —  HB 


[f  Me  ]  B  -  M(.By-HB) 


(2.5.14) 


We  still  have  the  complete  controllability  of  the  slow  and  fast  subsystem  pairs  in  (2.5.14) 
since  controllability  is  invariant  to  state  feedback.  To  achieve  the  fast  eigenvalue  placement 
objective,  we  pick  G  so  that 

\j  {  A  f  +  G  [B  —  M  (B  l  —  HB  )] )  =  .  l^ySSm.  (2.5.15) 

where  {  .  }  are  the  desired  fast  mode  eigenvalues.  Overall  we  have  achieved  the  eigenvalue 

assignment  in  two  stages  by  applying  a  composite  control  that  consists  of  slow  and  fast  feed¬ 
backs. 

u  =  Kp  +  Gcr  (2.5.16) 

The  input  can  also  be  expressed  in  terms  of  the  original  state  variables  x  and  z. 

it  ~Kp  +  Gcr  =  Kp  +  G(i)  —  Np) 

—  (K  —  GN  )p  +  G  T)  =  (K  -GN)(x  —  H  7))  +  C  t) 

=  (K  -  GN  )x  +  [G  -  (K  -  GN  )H  ft 

=  (K  -  GN  )x  +  [G  -  (K  -  GN  )H  ](z  -  Lx  ) 

=  ( K  —  GN  )  —  [G  -(K  —  GN  )H  ]Lx  +  [G  -  (A'  -  GN  )H  ]z  (2.5.17) 

We  now  investigate  how  the  slow  manifold  of  the  resultant  system  with  input  (2.5.16)  is 

characterized  in  (  x  .  z  Y  state  space.  From  (2.5.12)  when  the  system  is  on  the  slow  mani- 


V  =  Np  . 

eliminating  p  between  (2.5.18)  and  (2.5.7)  we  have 

T)  =  (I  +  NH  TXNx  . 
Substituting  this  into  z  =  Lx  +  7}  we  have 


(2.5.18) 


(2.5.19) 


z  =  Lx  +  (I  +  NH  )  1 Nx  -  [L  +  (/  +  NH  )  lN  }x  .  (2.5.20) 

Note  that  N  depends  on  K  but  not  on  G.  This  again  indicates  that  the  shifted  linear  integral 
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manifold  is  invariant  towards  the  fast  feedback.  Comparing  (2.5.20)  with  (2.3.1)  in  Lemma 
2.3.1  where  the  shifted  manifold  is  described  by  Lemma  2.3.1  as 


we  have 


i  —  (L  +  M  )x  . 


M  -  (/  +  NH  )  lN 


From  the  above  discussion  we  have  proved  the  following  theorem. 

Theorem  2.5.1 


By  assuming  the  complete  controllability  of  the  (  A  ,  B  )  pair  in 


A  composite  control  of  the  form 


=  A  I  +  Bu 


u  =  ax  +  $z 


will  achieve  the  eigenvalue  placement  objective,  where 

/3  =  G  -  (K  -GN  )H 
a  =  K  -  GN  -  PL  . 

The  constants  K  and  G  are  chosen  as  in  (2.5.11)  and  (2.5.15).  The  variables  L,  H  and  N  satisfy 
(2.2.3),  (2.5.8)  and  (2.5.13),  respectively. 

For  singularly  perturbed  systems,  we  have  similar  expressions.  Furthermore,  L,  H  and 
N  can  be  approximated  by  some  explicit  expressions  as  follows. 

Theorem  2-5.2 

To  assign  {  \s  ,  Xf  }  as  the  desired  eigenvalues  to  the  linear  system 


=  A  +  Bu  (2.5.21) 

ez  z 

where  )  \s  )  =  {  \s  l  \s„  I  are  the  desired  distinct  slow  eigenvalues,  and  (  !  =  { 

A ,  !  ....  A. }  are  the  desired  distinct  fast  eigenvalues.  Assume  the  full  controllability  of  the 
fast  and  slow  subsystem  pairs.  (  A  0  .  B ()  )  and  {  A  22  .  B  2  )  .  where 


i*i 

r» 


. .  .  .  . .  . . 
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4 


A  q  A  jj  A  i2A  22  ^  21  50  —  B  j  A  A  j->7?  ■ 

a  feedback  control  of  the  form 

u  =  Kx  +  G  (r  —  Ld  x)  =  (K  —  GLd  )x  +  Gz 
with  K  firstly  chosen  so  that 


and  then  G  picked  so  that 


will  result  in 


X;  (A  o  +  B  qK  )  =  X$i  ,  1  ^ i  $  i  ; 


X j  (A  22  +  5  2 G  )  —  fiX^r  ;  •  1^7 


(2.5.22) 


(2.5.23) 


(2.5.24) 


XIc  =  \1(A0  +  50Ar)  +  G(e)  =  Xri  +G(e)  . 

X,  =  X;  (A  ,2  +  5  2G  +0  (e))/€  .  i  =  n  +  j  ,  1  ^  j  $ 
where  {  X,c  }  are  the  eigenvalues  of  the  resultant  closed-loop  system.  Also,  the  Ld  in  (2.5.22) 


(2.5.25) 
m  .  (2.5.26) 

d 


satisfies 


Proof: 


A  2i  +  B  2K  +  A  22 Ld  =  6 Ld  (A  u  +  S  XK  +  A  nLd  )  .  (2.5.27) 


Apply  a  composite  control  of  the  form 

u  =  Uj  +  uf  =  Kx  +  uf 

to  (2.5.21)  .  (2.5.21)  then  becomes 


+  B  ius  +  u}  ) 


or 


X 

X 

. 

=  A 

ez 

z 

(2.5.28) 


(2.5.29) 


•€Z 


A  n  +  B  XK  A  12 


A  21  +  ^  A  22 


+  Buf  . 


(2.5.30) 


With  the  assumption  that  A  22  is  nonsingular,  (2.5.30)  has  a  manifold 

z  =  Ldx 

where  Ld  satisfies  (2.5.27)  by  Lemma  2.2.1  and 


Ld  —  Ld  +0  (e)  =  A  22*  (A  2i  +  B  -,K  )  . 
Take  tj  as  the  deviation  of  z  from  the  slow  manifold  z  —  Ldx  .  i.  e.. 


(2.5.31) 


'Si 

j 


BE 

-J 


We  have  from  (2.5.30). 
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*  c*. 


r)  =  r  -  Lj.x 


X 

a/ 

A  12 

X 

— 

+ 

0 

V 

B 

(2.5.32) 


where 


A*  =  A  n  +  B  jA-  +  .4  12i,rf  ,  A  K  =  A  22  ~  tLd  A  12  and  B  =  B  2 


~  eLd  B  j 


When  a  fast  feedback 


is  applied  to  (2.5.32).  we  have 


K  ^,2  +  5,0] 


0  A  +  5G  I  xn  ] 


The  above  system  matrix  differs  by  O  (e)  from  its  approximate  version 


:  £ 

A  o  +  B  o  K  A  12  +  B  x 

(2.5.33)  [ 

1 

0  A  22  +  B  2G  t) 

1 

As  =A0+B0K  +0{e)  and 

l  ^  A  •  /\  f  ' 


/4  +  5G  =  A  22  +  B2G  +0U)  . 

By  a  standard  theorem  in  singular  perturbation,  the  corresponding  eigenvalues  also  differ  by 
O  (e)  from  its  approximate  ones  [13],  i.  e.. 


X,  (A?)  =  \,C40  +  BqK  )  +  <?(€). 

\j(AK  +  BG)  =  \j(A22  + B2G)  +  Oie)  .  1  . 

Since  (2.5.33)  is  in  block-triangular  form  and  with  the  controllability  assumption  we  can 


choose  G  and  K  so  that  (2.5.23)  and  (2.5.24)  are  accomplished. 


The  closed-loop  system  has  a  shifted  slow  manifold 


2  =  Ldx  =  (L  +  M  )x  (2.5.34) 

where  L  is  governed  by  an  equation  related  to  the  A  entries  of  the  open-loop  systems.  In 


other  words.  L  is  inherently  related  to  the  eigenspace  or  the  eigenvalues  of  the  original  sys¬ 
tem.  Altering  the  eigenvalues  would  subsequently  result  in  a  new  eigenspace.  which  in  turn 
shifts  our  system  to  a  new  manifold  (2.5.34).  The  amount  of  work  required  to  achieve  this 
through  slow  feedback  is  directly  related  to  M.  the  amount  of  manifold  shifted  from  the  origi¬ 
nal  one.  As  we  can  see  from  (2.3.1).  M  is  a  function  of  both  L.  an  inherent  property  of  the 
open-loop  system,  and  K.  the  amount  of  feedback  applied.  We  now  study  a  singularly  per¬ 
turbed  system  and  give  an  implementation  for  the  eigenvalue  sensitivity  problem. 

Lemma  2-5.1 


The  singularly  perturbed  system 


X 

An 

A  12 

X 

B ! 

€i 

U  21 

A  22 

z\ 

+ 

B  2 

(2.5.35) 

l*J  l*2  r 

with  input  u  =  Kx  has  a  linear  integral  manifold 

z  =  Lx  (2.5.36) 

where  L  satisfies 

A21  +  B2K  +  A22L  =eL(An  +  B  +  Al2L) 

L  =  L0  +  eL  j  +  O  (e)  ; 

L,  =  —A  22  {A  2i  +  B2K „)  ;  Ll  =  A  22  [L„U  u  +  BtK0  +  A  12I0)  -  B 2K  J  . 

With  7}  as  the  deviation  from  the  slow  manifold  (2.5.36).  (2.5.35)  is  equivalent  to 


(2.5.37) 


As  ‘  —  A  u  +  B  XK  +  A  UL  ,  Ak  =  A  22  —  eLA  12 
Furthermore,  if  Ax  is  Hurwitz  for  €  €(0  ,e  ]  where  0  <  e  <<  1  .  (2.5.37)  will  be  on  the 

manifold  and  is  equivalent  to 


X 

A*  A  12 

- 

= 

0  .4* 

V 

x  =  A,  x  . 


Proof : 


(2.5.38) 
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Similar  to  the  proof  on  Theorem  2.5.2. 

Note  in  Lemma  2.5.1.  if  the  fast  subsystem  on  p  is  not  stable  .  i.  e. .  the  manifold  is  repul¬ 
sive.  we  can  stabilize  it  by  applying  an  appropriate  fast  feedback  and  thus  rendering  the  slow 
manifold  attractive.  We  are  then  justified  to  use  (2.5.38).  To  investigate  the  eigenvalue  sensi¬ 
tivity  problem,  we  need  the  following  Lemma  [  1 4], 

Lemma  2.5.2 

For  the  linear  system 

x  —  A  (e)x 

we  have  the  following  formula  regarding  the  eigenvalue  sensitivity  with  respect  to  the  param¬ 
eter  €  . 


<(— )v'  .  w'  > 


(2.5.39) 


<  W  '  ,  V  1  > 


where  v  (e)  and  w'(€)  are  the  respective  eigenvectors  of  /4(e)  .A  (e)  associated  with  the 
eigenvalue  A.,  . 

Proof: 

Take  v'  (e)  as  the  eigenvector  of  A  (e)  associated  with  the  eigenvalue  (e)  .  we  have 

A  (e)v' (e)  =  (e)v'  (e) . 

Taking  partial  derivatives  with  respect  to  the  parameter  e  on  both  sides  of  the  above  equation. 


04  ,  ,  40v'  x  0v' 

- v  +  A -  =  - v  +  A, - 

0€  0e  06  0€ 


(2.5.40) 


Left  multiply  with  w(.  on  each  terms  of  (2.5.40), 


(w');— f  (w‘fA—  =(w')r—  v'  +(w')rA,.—  .  (2.5.41) 

0€  0€  0€  0€ 

Observe  that  since 


A  ‘  w  =  A  w, 


so  we  have 
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& 

& 


1 


vv,  .4  =  \  vv'  , 


and  also  due  to  the  fact  that  \  is  a  scalar.  (2.5.41)  reduces  to 


r  QA 

(w  ‘  )  - V  '  =  - (vv  (  )'  V  1  . 


By  dividing  both  sides  by  (w‘  y  v‘  .we  have  (2.5.39). 


We  are  now  in  the  position  to  propose  a  design  for  the  eigenvalue  placement  problem  of 


singularly  perturbed  systems.  The  method  here  is  to  add  a  corrective  term  as  part  of  the  feed¬ 


back  to  the  singularly  perturbed  system,  so  that  the  eigenvalues  assigned  do  not  differ  more 


than  O  (e"  )  from  the  desired  one. 


Theorem  2-5.3 


For  the  single  input  system. 


Mii*4121U  [5, 


\A  „  A 


+  B,\U 


if  K,y  is  the  design  parameter  for  the  nominal  or  reduced  system. 


x  =  A  ()x  +  b  rt« 


where 


A  ()  A  A  12^4  22  A  2i  ■  B o  B  \  A  ^~>A  ->2  B 


such  that 


(A  o  +  B 0K {))  —  \id  , 

and  A  +  B  has  n  linearly  independent  eigenvectors  that  span  R "  space. 


a  feedback  of  the  form 


u  =  (K  +  eK  [)x 

will  place  the  eigenvalues  of  the  resultant  closed-loop  system  at 


X,  =A(J  +<?(€*) 

where  XJt  ,1  ^  i  $  n  ,  are  the  desired  eigenvalues. 


(2.5.42) 


‘.♦V'h'.iI,, 


^•3  35*  UK  VSB  Z&l  w  &U  W  *1*1*-  £& 


§  ^ 


1 

CTd 


where  v0  are  the  eigenvectors  of  A  0  +  B  qK 0  and 


<W0  MjVp  > 


<w0  .  B 0> 


<wl  .  A  jVp  > 
<w] . B0> 


where  <...>  stands  for  dot  product.  The  vectors  wj.l  ^  i  ^  n  .  are  the  eigenvectors  of 
(<4  y  +  B,tK 0f  and 

A  1  =  A  12(A  22  )2(^  21  +  B  2K0)  (A  0  +  B0K„)  . 

We  also  assume  that  <  wj,  .  B0  >  ^  0  ,  l^i^n 
Proof : 

By  Lemma  2.5.1  our  singularly  perturbed  system  is  equivalent  to 

x  =  A^(e)x 

if  the  fast  subsystem  is  stable  by  itself  or  through  fast  feedback  somehow. 

Note  that 

A*( e)  =  A  u  +  B  yK (e)  +  A12I(€) 

=  4*  +  eA,\  +  (e:) 

where 


A ; ,,  =  A  jj  +  B  1K0  +  A  l2L  i, 

=  .4  u  +  B  yK  0  —  A  12A  22  (A  2i  +  B  2K 0) 

—  (Ay  —  A  l2A  22  A  2j)  +  (B  j  -  A  l2A  22  B  2)K  0 
~  A  „  +  B  ()K  0 


•4t  i  —  5  jAT ;  +  /4  12Z-  [ 

—  B  XK  y  +  A  12/4  ^L0(A  0  +  B  0)  —  A  12.4  2->l B  -,K , 
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=  (B  l  —  A  l2A22lB2)Kl  -  A  12U22-  )2U2i  +  B0K,X- 4„  +  £0*o) 


=  B ,,A'  j  -  A  12(.4  22  )”(.4  21  +  B2tf0)U0  +  £0*o) 


-  B  0K  i  —  A  j  . 
Applying  Lemma  2.5.2. 


AV  _  ^  •<3e)..»<>  _  <»i  ,A*K> 

(  ) «  =  0  —  “ 

<Wq,vq>  <w‘  ,  v'  > 


In  order  that  the  first  term  on  RHS  of  (2.5.44)  vanishes,  we  require 

<Wq  .  (B qK j  —  A  j)vq  >  =  0  .  1 


<Wg  .  B  gifjVg  >  =  <Wq  ,  A  jV^  >  .  l$t$n 


<W0 

o  - 

V 

=  - 

<wo 

■  B0> 

<wo  ■ 

<4  ivo  > 

A 

C  O 

c  © 

s 

V 

<w0 

■  B  0> 

<wl  -B0> 

provided  <w')  ,B0>^0  .  i.  e.. 

<w01  ,  AjVq  >  <Wo.A1Vq> 

A',  . v'|  =  . . . 

<wo  •  50>  <v%  ,B0> 

From  (2.5.46).  we  have  (2.5.43).  By  (2.5.44)  and  (2.5.45)  we  have  (2.5.42). 


(2.5.44) 


(2.5.45) 


(2.5.46) 


In  the  proof  of  the  above  theorem,  we  note  that  if  B  0  is  nonsingular,  we  can  take 


K1*B0iAl 


to  achieve  the  same  task.  One  merit  of  this  kind  of  corrective  measure  is  that  the  feedback 
controller  based  on  the  nominal  model  can  still  be  used.  Only  an  additional  term  is  added  to 
the  controller  to  compensate  for  the  effect  of  parasitics  that  is  inherent  in  the  singularly  per¬ 
turbed  system. 
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2.6.  Application  of  Slow  Manifold  to  Tracking  Problems 

We  shall  investigate  the  tracking  problem  of  a  singularly  perturbed  system  in  which  the 
slow  part  is  required  to  track  a  prescribed  trajectory.  When  the  fast  part.  i.  e..  the  deviation 
from  the  manifold,  is  asymptotically  stable  the  deviation  goes  to  zero  at  the  rate  of  0(  l/€  ). 
We  can  then  consider  the  system  as  restricted  to  the  slow  manifold  and  thus  simplify  our 
design.  Tracking  of  this  type  arises  in  many  situations.  The  tracking  problem  of  the  flexible 
link  manipulator  is  just  one  of  such. 

By  following  (2.3.29)-(2.3.31)  in  Section  2.3. 


\A  ii  A  i2 1  \x 


1  €Z  1  iA  21  A  22 


+  *J“ 


(2.6.1) 


is  equivalent  to 


\As  Al2  A12  +uf  )j 


V  =  0  A  0  p  + 


0  0  A 


(2.6.2) 


where  As  .A  and  B  are  as  defined,  and 


As  (e)  =  Aso  +  €.4^+0  (e") 

—A  u  +  A  nL()  +  eA  l2L  j  +  O  (e2) 
=  A  0  +  eA  l2L  j  +  O  (e2) 


A  =  A0  +  eA  [  +  O  (€*) 

—  A  22  +  €( — L  qA  12)  +  0  (e2) 

-  A  22  +  €A  22  A  2\B  1  +  o  (e2)  . 

It  is  assumed  that  the  fast  variable.  r\  .  is  available  for  feedback  control.  When  the  fast  sub¬ 
system  of  7)  is  stable  by  itself  or  somehow  through  the  fast  feedback,  uf  -  C  7)  ,  the  system 
will  be  on  the  manifold  so  (2.6.2)  is  equivalent  to 
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=  ,  +  _  u  (2.6.3) 

ep  0  .4  Lp  5 

Suppose  the  slow  variable  is  required  to  track  a  given  trajectory  xd(t)  ,  which  is  assumed  to 
be  infinitely  differentiable.  By  setting 


=  x,.  —  a(.r  —  Xj  ) 


e  =  —cue 


(2.6.4) 


(2.6.5) 


where 


e  (t  )  =  x  (t )  —  xd  (t  ) 

is  the  error  between  the  output  of  the  system  and  that  of  the  desired  trajectory  at  time  t. 
With  a  >  0.  we  have  (2.6.5)  as  a  stable  system  and  x  will  track  xd  (t  )  as  desired. 

We  can  solve  p  up  to  any  order  of  €  algebraically. 

ep  (e)  =  A  {e)p  (e)  +  B  (e)u  (e) 

Equating  the  coefficient  of  €°  in  the  above  equation. 

€  :  A  oP  o  +  B  qU  o  =  0  . 


Similarly. 


P o  “  A0  B 0u 0  —  A  22  B 2u o  • 


e1  :  Pq  =  Anpx  + A  xp0  + B^^A  Bu{,  . 


Pi  =A2z  (Po~aiPo~boui 

—  —A  22  {A  22  B  2^  0  L  tyA  12A  22  B  2U  0  A  B  2U  1  —  B  O®  lw  0^ 

—  A  22  ( *4  22  B  iA  0  B  o5  2^0"^  B  2^  0  ~~  P  0  '  w  1  ■  ^  0^  ' 
In  general. 


»V«v«ViY‘Y»v, 


e  :  p,  -1  =  Z  (Ap,  ) 


/>r  =^221t>r-l“^0^  +  Z  CAiPr~,  +  “r  -  ,  M 

i  =  1 
r 

=  ^  22  [pV  -  1  _  2Ur  ■*"  Z  -  1^  1 2Pr  -  l  "*■  &  lUr  -  i  ^ 

I  =  1 

whence  it  can  be  shown  that 

Pr  =  P,^U  O  - - Ur  ■“  o - “r  -])  ■ 

From  (2.6.3).  the  slow  variable  is  governed  by 
x  =  As  x  +  .4  l2p  +  B  xu 

=  C4s0x  +  Al2p0  + B  yU0)  +  t(Aslx  +  A  l2p  y  +  B  xu  j)  +  0(e2) 

=  (-4  qX  *h  ( B  i  *”  .4  ^2^4  22  ^  21^ 4"  e(4  j2-^  yX  ~¥  A  ^ 2P 1  4“  B  yU  y) 

+  •  ■  ■  +  e  (A  uLr  x  +  A  i2Pr  +  B  yUr )  +  •  •  • 

where 


(2.6.6) 


(2.6.7) 


^  0  —  ^  11  4  12Z.0  —  4  n  12^4  22 21 

and  B  0  —  B  y  —  A  ^4  -j'?  B  ->  . 

We  should  pick  u0  .so  that  in  the  nominal  model,  i.  e..  the  one  obtained  by  setting  the  parasi- 


tics  €  =  0  . 


A0x  +  B0u0  =  v 


(2.6.8) 


u0  =  Z?0  1  (v  —  A0x)  =  u0(x  ,xd  ,xd)  (2.6.9) 

and  u,  so  that  coefficient  of  €  .  l^r  <00  ,  in  (2.6.7)  vanish.  Here  we  assume  £0  to  be  non¬ 


singular.  In  this  manner  the  resultant  closed-loop  system  becomes 


x  =  A  qX  +  B0u  =  v 


(2.6.10) 


and  hence  (2.6.5).  The  tracking  objective  is  thus  achieved.  We  now  show  how  the  derivatives 
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of  u „  are  expressed  in  terms  of  x.  the  state  of  the  system,  xd  ( t  )  and  the  higher  derivatives  of 


From  (2.6.8)  and  (2.6.4) 


“o  =  Bo  1  (v  ~  Aox  ) 


-B0  (xd  —  a(x  —  xd)—A()x) 


=  B  0  1  [xd  -  axd  —  (A  0+  al)x]  . 


(2.6.11) 


Differentiating  both  sides  of  (2.6.11)  and  use  the  fact  that  when  an  appropriate  control  of  the 


u  =  u  0  +  eu  j  + 


is  applied  to  the  system  on  the  manifold  we  have  (2.6.10). 


a0  =  B0  1  [xd  -axd  -  (.4  0  +  <xl  )v  ] 


=  B  0  1  [xd  -  axd  -  {A  0  +  al  )(xd  -  aU  -  xd  ))] 


=  u  0(x  ,  xd  ,  xd  .  xd)  . 


In  a  similar  manner,  we  have 


ur_x=ur_^x  ■  xd  •  xd  xdr  +  ,  r^l 

Hence,  from  (2.6.6).  (2.6.9)  and  (2.6.12)  we  have 


(2.6.12) 


_  /  (r  +  X  N  ^  rv 

pr  =  pr  U  .  xd  .  xd  ....  xd  )  ,  r  20 

Therefore,  we  should  design  our  control  ur  .  1  <oo  ,  based  on 


ur  =  ur(x  .  pr )  =  ur  (x  .  xd  .  xd  ....  xd  +  )  . 

That  is  to  say.  to  implement  the  control  we  need  the  state  of  the  system  .  x,  the  desired  trajec¬ 


tory.  xd  (t  )  .  and  its  higher  derivatives  which  are  assumed  to  be  known  a  priori.  When  €-*0  , 


(2.6.1)  reduces  to 


:  -  —4, 22  (A  21x  +  B7u) 


x  =  A  ux  +  A  12r  +  B  xu 


=  (.4  n  —  A  l2A  22  A  21)x  +  (B  j  —  A  12A  22  B  2)u 


~  A  qX  +  B  0u  . 


(2.6.13) 


Thus,  for  our  design 
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W  =B„  +  a(  ■ 

u„  is  the  required  control  for  the  tracking  problem  based  on  the  unperturbed  or  reduced  model 
(2.6.13),  and 

uc  =  e(u  j  +  €u  2  +  •  •  ■  ) 

is  the  corrective  control  to  be  added  to  compensate  for  the  effect  of  parasitics  present  in  the 
system.  The  parasitics  in  the  case  of  a  flexible  link  manipulator  will  be  the  flexibility  of  the 
robot  arm.  Note  that  by  appending  a  corrective  feedback  control  to  the  real  system  the  singu¬ 
larly  perturbed  system  will  behave,  to  a  naive  user,  as  if  it  is  parasitics  free.  Figure  2-3  shows 
the  block  diagram  of  the  controller  which  achieves  O  (€“)  tracking  accuracy.  This  completes 
our  discussion  on  the  tracking  problem  using  the  slow  manifold  concept. 


i 


;§ 


§ 


3.  APPLICATION  OF  INTEGRAL  MANIFOLD  TO  FLEXIBLE  LINK  MANIPULATORS 


3.1.  Introduction 

There  are  two  main  reasons  why  we  want  to  investigate  the  control  problems  of  flexible 
manipulators.  First,  control  algorithms  which  assume  a  rigid  model  for  the  manipulator  are 
not  satisfactory  when  applied  to  real  robots  where  perfect  rigidity  is  not  a  good  assumption. 
Second,  most  robots  are  built  to  be  mechanically  stiff  simply  because  of  the  difficulty  of  con¬ 
trolling  the  flexible  members  and  not  because  rigidity  is  itself  inherently  attractive.  A  great 
deal  of  research  has  been  devoted  to  this  issue  in  recent  years[6,  15-18], 

In  this  chapter,  the  flexibility  in  flexible  manipulators  is  interpreted  and  shown  to  be  the 
cause  of  phase  delay  in  its  performance.  A  phase-lead  prefilter  is  appended  to  eliminate  the 
error  due  to  flexibility.  A  time  domain  analysis  using  integral  manifolds  gives  an  analogous 
result  and  provides  a  simple  approximate  corrective  scheme  to  the  control  problems  of  the 
flexible  link  robot. 

3.2.  Modeling  of  a  Flexible  Single  Link  Manipulator 

To  demonstrate  our  principle,  we  designed  a  feedback  control  which,  when  being  applied 
to  the  flexible  manipulator,  results  in  a  performance  that  is  arbitrarily  close  to  the  rigid  one. 
In  particular,  we  illustrate  our  idea  by  designing  a  controller  that  gives  the  flexible  manipula¬ 
tor  a  performance  O  (e2)  close  to  the  rigid  one.  The  small  constant  €  =  0(  — )  ,  where  k  is  the 

k 

flexibility  constant.  First,  derive  an  approximate  model  of  a  single  flexible  beam  as  a  linearized 
singularly  perturbed  system.  For  convenience  we  restrict  our  discussion  to  a  single  planar 
flexible  link  as  shown  in  Figure  3-1.  We  assume  the  mass  of  the  link  is  uniformly  distributed 
and  that  gravity  acts  normal  to  the  plane  of  motion  and  thus  can  be  ignored  subsequently.  We 
model  the  flexible  planar  link  as  an  interconnection  of  n  rigid  links,  each  with  length  li  and 
mass  ml  .  as  shown  in  Figure  3-2.  It  is  assumed  that  the  links  are  connected  by  linear  torsional 
springs,  each  with  stiffness  k.  and  we  assume  that  k.  is  large.  The  flexible  manipulator  is  thus 
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represented  as  a  planar  n  link  mechanism.  As  a  consequence,  we  establish  a  coordinate  system 
at  the  base  and  at  each  link  as  shown  in  Figure  3-2.  Let  qxq2.  •  •  • <?„  be  corresponding 
joint  angles  measured  with  respect  to  these  coordinate  frames,  and  let  /,  be  the  moment  of 
inertia  of  the  i  th  link  about  the  z,  axis  which  is  normal  to  the  plane  of  motion  of  the  manipu¬ 
lator.  For  simplicity,  we  take  /,  =/ .  for  all  i  —  1 . n  .  Then  the  kinetic  energy  of  the  j 

th  link  is  given  by[l9] 


1  r  1  T 
K  =  —m  V  V  +  —oi  I  w 

j  2  1  CJ  CJ  2  J  J 


(3.2.1) 


where  oi,  .the  angular  velocity  of  the  j  th  joint,  is  given  by 


<o J  =  (q  I  +  q  2  + . +  ij  )z  (3.2.2) 

and  q  l  is  understood  to  be  the  angular  velocity  of  the  first  joint,  etc. 

By  following  the  standard  derivation  of  the  kinematic  motion  of  any  point  on  the  manipulator 
with  rotational  joints[l9].  the  velocity  of  the  center  of  mass  of  the  j  th  link,  VCJ  ,  is  given  by 


V  -  J  q 

CJ  J  j'i 


where 


’  •J'l 

T 

► 

1 

q  =  qi ■ q2  -  • 

■  ■  <?„ 

and  Jj  =  Jj  j  ,  .  . 

■Jin 

Jjt  ,  the  Jacobian  of  the  center  of  mass  of  the  j  th  link  with  respect  to  the  (i-l)  th  joint  is 
given  by 


Jn  =  |z  X  {Ocj  -0^)1  ,l^y 
=  0  .  j  <i  ^ n  . 

The  position  of  the  i  th  joint.  1  ^  i  ^  n  —  1  .  is 


O,  =  x  Z  j  cos?  j  +  1 2  cos  (q  j  +  q 2)  + . +  Z,  cos  (q :  +  q2  + .  +  q,  ) 

+  y  [z  j  sin  q  1  +  Z2  sin  (q  x  +  q2)  +  ,  .  .  .  ,  +  Z-  sin  (?,+  ,  +  q{  )  I 


+  y  j  Z  j  sin  q  1  +  Z2  sin  (q  x  +  q2)  +  ,  .  .  .  ,  +  Z,  sin  (<?  j  +  + 

The  position  of  the  center  of  the  mass  of  the  j  th  link  is 


O.  ,  =  r. .  =  x  l  j  cos  q  ,  + . +  Z;  _i  cos  (q  l  +  q  ,  + .  +  q,  _])  +  Zcy  cos  (q  j  +  q  2  + .  +  <?y  ) 
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+  y  / 1  sin  q  j  + . +  fy  sin  (9 ,  +  9,  + .  +  _[)  +  fcy  sin  (4  j  +  q  2  +  ,  .  .  .  ,  4 ■  q ,  )  . 


From  a  symmetry  consideration,  we  take 


l,  =  l  =  L  In 


(3.2. 3.a) 


m,  =  m  =  M  In 


(3.2. 3. b) 


lcj  = 1/2 


(3.2.3.c) 


/=/..=  mT  /12 . 


(3.2.3.d) 


With  L  being  the  length  of  the  undeflected  beam,  M  being  the  mass  of  the  whole  beam,  and 


being  the  distance  of  the  center  of  mass  of  the  j  th  link  from  the  j  th  joint.  By  (3.2.1)-  (3.2.3) 


the  total  kinetic  energy  K  of  the  manipulator  is  then  the  sum  of  the  individual  kinetic  energies 


m  r  1  t 

K  =  -  I  <  V.,  t-Z*' ", 


=  -«r(£^/p?  +  -?r(£ifE, -)« 

2  i  = ,  2  i  = .  i 


=  -?r  I  +  /£ft  i)  j 


=  —  qT  M  (q  )  q 
2 


where 


0  0 


(n  —  1  X  n 


ly  x  y  is  a  square  j  X  j  matrix  with  all  entries  being  unity. 


By  restricting  our  study  to  slightly  flexible  manipulators,  we  have  a  small  deflection  along  the 


link  and  this  indicates  that 


(?2.?3 - )  ~0(e) 


where  €  is  a  small  positive  number. 


As  a  matter  of  fact,  with  some  trigonometric  and  algebraic  simplification. 
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M  (q  i  ■  q2 . ?„  )  =  A/  (g 2  ■  1  i . ?„  )  =  A/  +0  (e")  (3.2.4) 

when  we  expand  it.  This  means  that  M(q)  is  only  a  function  of  fast  variables,  (q  2,  .  .  .  ,qL  ). 

and  can  further  be  approximated  by  a  constant  matrix  Mc  which  is  positive  definite  and  sym¬ 
metric.  Since  we  are  mainly  interested  in  designing  corrective  feedback  control  up  to  0(e2) 
accuracy,  it  is  thus  acceptable  to  take  Mc  instead  of  M(q)  in  our  derivation  that  follows.  The 
potential  energy  P  of  the  manipulator  in  this  case  is  the  sum  of  the  elastic  spring  potentials 

P  =  —  (  <?  2"  + . +  q~  )  =  P  (q  ) 

where  k  is  the  torsional  spring  constant  and  q,  are  the  relevant  angular  displacements  at  each 
fictitious  joints.  Euler-Lagrange  equations  are  then  of  the  form 


L  =  K  -  P  =K(q)-P(q) 

where  K  (q  )  is  a  valid  approximation  of  the  total  kinetic  energy  to  O  (e")  accuracy. 


QL  .  d  QL 
-  =  Mq  .  —  -  =  Mq 

dq  dt  dq 

dL  -  -  ir  ,  <  < 

-  - - -  —kq  .  2  ^  j  ^  n 

dq,*}, 

=0  .y=l. 

Assuming  that  there  is  a  viscous  damping  term  -  d.l  qt  at  the  joints,  the  system  equation  that 
describes  the  flexible  beam  can  be  written  as 


1 

0 

M{q)q  +  ^  ^  k  q  +  dq  =  u  .  (3.2.5) 

^  K  - 1 

0 

By  the  fact  that  M  is  nonsingular  and  can  be  approximated  by  a  constant  matrix  as  in  (3.2.4). 
(3.2.5)  is  equivalent  to  the  following  with  0  (e‘)  approximation. 

q  =  Dq  +  A  kq  +  Bu  (3.2.6) 

where  D.  A,  B  are  all  constant  matrices 
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By  scaling  (^3 . q,l)  =  (ez2 . €rfl  )  =  e:  with  e-\/k.  we  have 


</  =  (^  j . );  =  (x  .ec  )‘  ,  where  x  =  ?  i  •  Without  loss  of  generality,  we  take  e  —  e 


Equation  (3.2.6)  becomes 


D  11  D  12  X  ^  1  ^  1 

^  +  z  +  _  u  . 

D  21  D  22  ez  A  2  B  2 


(3.2.7) 


The  rigid  or  reduced  model  can  be  deduced  from  (3.2.7)  by  setting  6  =  0.  This  is 


equivalent  to  having  an  infinitely  stiff  beam  which  is  also  the  undefiected  rigid  beam. 


Setting  €  =  0  gives 


£  =  —  .4-T1  (D21x  +  B2u)  . 
Substitute  this  into  (3.2.5)  and  simplify 


x  =  (D  u  —  A  1A21D21)x  +  (5  j—  A  1A21B2)u 


x  =  Ar  x  +  Bru 


(3.2.8) 


(3.2.8)  can  be  compared  with  the  system  equation  from  the  rigid  beam  derivation.  They  are 


found  to  be  identical. 


A  more  realistic  modeling  of  flexible  link  manipulators  can  be  obtained  by  using  the 


modal  analysis.  A  flexible  link  manipulator  with  a  concentrated  mass  is  shown  in  Figure  3-3. 


The  deflection  along  the  flexible  link.  8(x  .  i  )  .  is  a  function  of  both  time  and  position  along 


the  link.  0  ^  x  ^  l  ,  where  1  is  the  length  of  the  undeflected  link.  The  deflection  8(x  .  t  )  is 


governed  by  the  beam  equation  with  the  boundary  conditions  where  the  beam  is  clamped  at 


one  end  and  free  at  the  other  end. 


,,  a  s  a  s 

£/  =  -p 

0*  V 


(3.2.9) 


where  the  constants  are.  respectively. 


E:  Young's  Modulus. 


I:  beam  area  inertia. 


p:  density. 


wwmmr 
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With  the  assumed  mode  method.  8(x  ,  t  )  can  be  represented  as  an  infinite  series  of  separ¬ 


able  modes 


S(x  .  t  )  =  £  TTI  (x  )0,  (x  ) 


(3.2.10) 


where  0,  (f  )  -*  0  as  i  -*  oo  [20],  For  a  realistic  representation  of  a  slightly  flexible  beam,  a 


good  approximation  can  be  obtained  by  truncating  (3.2.10)  after  the  first  few  terms. 


The  functions  rr,  (x  )  are  the  eigenfunctions  of  the  PDE  (3.2.9)  and  satisfy 


El  -  =  lof  P  7T,  (x  ) 

5* 4 


We  treat  0,  as  part  of  the  generalized  coordinate  q  =  (0 , 0)'  ,  where  0  is  the  joint  angle  of  the 


relevant  link.  Through  Lagragian  formulation  the  flexible  link  manipulator  car.  be  modeled  by 


the  following  state  equations[2l]: 


M  iq)q  +  °Q  1  °  k  q  +  dq  =  Q  u 


(3.2.11) 


where  q  =(0.0)  and  Q  is  a  constant  vector.  The  dq  term  accounts  for  damping.  Constant  k 


is  a  normalized  stiffness  constant  that  arises  as  a  result  of  the  presence  of  link  flexibility  and  is 


related  to  the  payload  mass,  length,  cross-section  area,  cross-area  inertia,  density,  and  the 


Young's  modulus  of  the  beam.  A  quick  comparison  between  (3.2.5)  and  (3.2.11)  reveals  the 


fact  that  both  ways  of  modeling  flexible  link  manipulators  lead  to  two  equivalent  system 


representations,  though  there  is  no  one-one  correspondence  of  the  state  variables  between 


them.  For  a  single  flexible  beam  with  no  payload  that  has  its  motion  restricted  to  a  horizontal 


plane  [18],  it  can  be  verified  that  M(q)  is  a  function  of  fast  variables  (deflection  variables)  0, 


alone  and  can  further  be  approximated  by  a  constant  matrix  as  in  (3.2.4).  This  again  justifies 


jur  wav  of  modeling  the  flexible  beam  as  n  sublinks  each  connected  to  the  other  through  a  stiff 


spring  except  at  the  base  where  it  is  hinged  upon  a  rigid  joint.  Neglecting  the  damping  effect. 


Judd  and  Falkenburg  used  the  Denavit-Hartenberg  4-parameter  representation  for  modeling 


the  flexible  beam  and  came  up  with  a  set  of  system  equations  identical  to  (3.2.11)  with  the 


Jr 
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damping  term  omitted  [22]. 

3.3.  Existence  of  Integral  Manifold  in  Flexible  Link  Robot  System 

The  flexible  manipulator  system  (3.2.7)  can  be  rewritten  as  the  following  singularly  per¬ 
turbed  linear  svstem 


*1 

0 

I 

0  0 

*1 

0 

x  2 

0 

Dn 

^  1  V-D  12 

*2 

+ 

*1 

A-'i 

0 

0 

0  / 

-  1 

0 

0 

-42  M-^22 

~  0 

&  2 

(3.3.1) 


1/2 


where  pc  =  €  '  ,  x  ,  =  x  ,x2  =  x  .  z  t  =  z  .  and  z  2  —  /xz 
This  can  be  rewritten  in  a  more  compact  form  as 


X 

VZ 


\A  a  A  12 


B , 


(3.3.2) 


[A  21  A  22  J 

where  X  =  (xl,x2).Z  =  (r  t  .  z2)  and  AtJ  and  B,  correspond  to  appropriate  entries  in 

(3.3.1). 

Due  to  the  nonsingularity  of  M(q).  .4  2  is  nonsingular  and  hence 


-l 
■  22 


0  / 

-1 

M-4  2  D  22  -4  2 

i4  2  fzD22 

/  0 

(3.3.3) 


By  (3.3.3)  the  existence  of  a  conditionally  attractive  manifold  for  (3.3.2)  is  assured  [  1 1  ]. 
From  Corollary  2.2.1  of  Chapter  2.  the  integral  manifold  is  of  the  form 

Z  =  LX  +  P 

where  X  =  (x,  .  Z  =  (2 1  ,  r2)'  and  L  is  a  2  X  2  constant  matrix. 

By  Corollary  2.2.1,  L  satisfies  the  following  equation: 


0  0 
0  D2\ 


0  / 

A  2  22! 


L  -  n  L 


0  I 
0  D 


11 


0  0 
I A  1  V-D  ,2 


L  } 


$ 


.V 


3 

s 

$ 
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Solving 


& 


\ 

t 

X 


0  -/J.A  2  D2l  , 

L  =  _j  '  _!  +  Oin") 

|0  -A2D2l(Du-AiA2D2l) 


and  P  satisfies 


fj.P  =  AP  + 

with  .4  =  .4  22  —  /uLA  12  and  5  -  B2~  V-LB  t  . 

For  our  system  to  start  on  manifold  Z  =  LX  +  P  .  it  is  necessary  and  sufficient  that 


Z  (r0)  =  LX(r«)  +  />(f0)  =  LX(t0) 


(3.3.4) 


since  P  (t  „)  =  0  . 


We  recall  that  {X  ,  Z  )  represents  the  positions  and  velocities  of  the  joints  and  deflections, 
respectively.  One  of  the  initial  conditions  that  would  satisfy  (3.3.4)  is  the  one  where  the  robot 
starts  from  rest  with  undeflected  links  in  the  "zero"  position.  In  this  case,  we  have 
(X  (r  0)  ,  Z  (r  0))  =  0  and  (3.3.4)  is  trivially  satisfied. 


3.4.  Flexibility  as  a  Cause  for  Phase  Delay 

It  is  intuitive  that  for  a  robot  with  perfect  rigidity  the  links  and  the  end-effector  will 
move  accordingly  when  the  motor  starts  running  as  a  result  of  the  applied  input  torque.  How¬ 
ever.  for  a  robot  with  flexibility  in  either  links  or  joints,  the  end-effector  does  not  move  simul¬ 
taneously  with  the  motor.  Furthermore,  the  trajectory  of  the  robot  arm  does  not  follow  the 
expected  one  exactly.  This  phenomenon  becomes  more  noticeable  with  the  increase  of  input 
frequency  that  in  turn  excites  the  inherent  flexible  modes  in  the  robot.  We  shall  interpret  this 
as  a  phase  delay  due  to  the  flexibility  in  the  manipulators. 

Referring  to  the  flexible  beam  in  Figure  3-3.  the  position  of  the  mass  m  at  the  tip  of  the 
beam  is  described  by 

y  =  I9(t  )  +  8(1  ,t). 

where  L  0  is  the  arc  traversed  by  the  tip  of  the  undeflected  beam  from  the  reference  frame  and 
8( l  ,  t  )  is  the  deflection  at  the  tip  of  the  beam. 

By  (3.2.101.  (3.3.1)  and  the  fact  that  we  take  as  the  scaled  version  of  the  deflection  vari- 
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ables  0  .  i.  e..  €r  j  =  <+>  .  we  have 

n 

v  =  Z  9(/  )  +  £  w:-  (Z  Cr ) 

i  =2 

=  lx  J  +  e  (772(Z )  .  7T3(Z )  .  •  ■  •  .  irn  (Z ))  2  3 

Since  X  =  (x  l  .  x  2)r  .  Z  =  (2  j  ,  z  2)r  .  we  have 

y=C0X+eC,Z  (3.4.1) 

=  C0X  +m2C1Z 

where  C0  *  (Z  .  0)  .  C  t  =  (tt2(Z  )  ,  •  •  ■  .  tt„  (Z )  .  |  0  ,  •  •  ■  .  0)  .  e  =  fi2 

Thus,  we  have  the  movement  of  the  mass  m  at  the  tip  of  the  flexible  beam  governed  by  a  linear 

time-invariant  system  (3.3.2)  with  linear  output  (3.4.1). 

The  movement  of  the  mass  m  on  a  rigid  beam  is  described  by  the  following  system  equa¬ 
tions: 

X  -  A0X  +  B0u'  (3.4.2) 

y  =  C0  X  (3.4.3) 

^  0  =  A  n  —  A  12A  22  *4  21  •  B  0  =  B 1  —  A  12A  22  B2 
where  (3.4.2)  and  (3.4.3)  are  obtained  by  setting  fi  =  0  in  (3.3.2)  and  (3.4.1)  respectively. 

The  frequency  domain  representation  of  (3.4.2)-(3.4.3)  is  given  by 

Y  =C0(r/  -A0TlB0U  =  C o  (j/  -  A  u  +  A  l2A  22A  21)_1  B0U  .  (3.4.4) 

The  flexible  beam  system  (3.3.2)  as  restricted  to  the  manifold  Z  =  LX  +  P  is 

X  ={An  + Al2L)X  +  Al2P  +  Bxu  (3.4.5) 

[lP  =  AP  +  Bu  .  (3.4.6) 

The  frequency  domain  representation  of  the  movement  of  mass  m  on  the  flexible  beam 

described  by  (3.4.5)-(3.4.6)  is  given  by 

Y(s  )  =  C0X (r  )  +  /u2C1(Z,X(r  )  +  Pis  )) 

=  C0(jZ  -An-  Al2L)~l(Bl  +  A12(jjlsI  —  A  )~*  B  )U 
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+  M2C !  (  LCa  (si  -An-Al2L)  1  (  B 1  +  A  12  {ysl  -  A)  1  B  )  +  {/xsl  -  A)  1  B  )U 


Note  that 


(fxsJ  —  A)  1  =  —  (/  +  (jlsA  ')A  1  +  O  (m2) 


Y  =  C0  (r/  ~  A  u  -  A  12Z  )_I  (  3 :  -  A  12  (/  +  /xxA  X)i  *3  )  U  +  0  iy)  (3.4.7) 

where,  as  a  reminder.  A  =  A  22  +  O  (/x)  .  3  =  3  2  +  O  Ox)  .  L  -  —A  22A  21  +  O  00 
As  m  —  0  the  flexible  beam  reduces  to  a  rigid  beam  and  consequently  (3.4.7)  becomes  that  of 
(3.4.4).  One  can  check  this  easily  by  setting  fx  =  0  in  (3.4.7).  Comparing  (3.4.7)  with  (3.4.4), 
we  found  the  perturbation  parameter  fx  ,  which  arises  due  to  the  presence  of  flexibility,  induces 
a  phase  delay  term  fzsA  1  in  the  flexible  system  output. 

To  illustrate  the  principle,  we  consider  a  scalar  singularly  perturbed  system  similar  to 

(3.3.2)  that  describes  the  flexible  beam: 

x  —  ax  +  bz  (3. 4. 8. a) 

fxz  -  —z  +  u  (3.4. 8. b) 

where  0  <  y.  «  1  .  and  x.  z.  and  u  are  scalars.  Equation  (3.4.8)  is  a  simplified  version  of 

(3.3.2) .  We  shall  name  (3.4.8)  as  the  flexible  model  with  \x  representing  the  stiffness  constant. 
The  rigid  model  is  obtained  when  we  let  fx  -*  0  .  This  results  in  z  =  u  in  (3.4.8.b).  Substitut¬ 


ing  this  into  (3. 4. 8. a)  gives  the  rigid  model  equation 


x  =  ax  +  bu 


(3.4.9) 


•  Frequency  domain  analysis 


The  Laplace  transform  of  (3.4.8)  with  zero  initial  condition  is 


X(s  )  =  - U(s) 

is  —  a  )  ( 1  4-  ys  ) 


(3.4.10) 


where  s  =  j  cu  .  co  represents  frequency.  Functions  X(s)  and  U(s)  are  the  Laplace  transform 
of  x(t)  and  u(t)  respectively. 


When  fj.  —  0  .  i.  e.,  the  spring  constant  -•  oo  .  (3.4.10)  reduces  to 


X  is  )  = - U  is  ) 

is  —  a) 


(3.4.11) 


which  is  precisely  the  frequency  domain  representation  of  the  rigid  model  (3.4.9). 

By  comparing  (3.4.10)  with  (3.4.11)  one  would  readily  see  that  there  is  a  phase  delay  of 
tan  in  the  output  performance  of  a  flexible  robot  if  a  control  based  on  rigid  model 

assumption  is  applied  to  it.  It  is  easy  to  see  that  phase  delay  will  increase  with  the  increase  of 
input  frequency.  This  explains  why  in  a  slightly  flexible  robot,  high-speed  performance  is 
usually  not  satisfactory,  though  it  is  fairly  acceptable  at  low-speed  maneuvers.  The  Taylor 
series  expansion  of  (3.4.10)  with  respect  to  fj  is 


b 

is  —  a  )  (1  +  /jls) 


b  (1  —  /is  ) 
is  —  a  ) 


+  O0T) 


(3  4.12) 


-Neglecting  <2(/x')  terms  in  (3.4.12)  and  comparing  it  with  the  rigid  model  (3.4.11),  we  notice 
that  there  is  an  additional  unstable  zero  in  the  flexible  robot  system.  This  is  first  observed  in 
[23].  Thus  we  have  shown  that  flexibility  not  only  causes  a  phase  delay  but  also  induces  an 
unstable  zero  in  the  system. 

In  order  that  the  behavior  of  the  flexible  model  be  like  a  rigid  one  in  the  mid-frequency  range 
where  O  i  i/u.s  )‘  )  is  negligible,  we  must  use  a  control  u  such  that 

b  b  ( 1  —  ns  )  _ 

- Uis)=  - —  U(s)  . 


is  —  a) 


is  —  a) 


Whence 


Uis)  = 


Uis ) 


(3.4.13) 


( 1  -  ns) 

Note  that  U  is  )  is  obtained  by  sending  the  rigid  control  through  a  phase-lead  compensator. 


•  Time  domain  analysis  using  integral  manifold 


By  Corollary  2.3.2,  (3.4.8)  possesses  an  attractive  input  dependent  integral  manifold  of 


the  form  :  =  p  ,  where  p  satisfies 


jip  =  -p  +  u  . 

With 

X  =  X  0  +  (XX  j  +  /I  x  t  ■+■  ... 

P  ~  P0  +  PP i  +  M2/>2  +  - 

U  —  U  0  +  flU  ,  +  fJL2U  2  +  ... 

We  have 


Po  -  u  ■  Pi  =  “  t  -  “o  •  '  ■  •  ■ 

So 

x  =  ax  +  bu0  +  pJ>  (u  j  —  ti0)  +  Oifi2)  .  (3.4.14) 

Xote  that  at  /jl  =  0  .  (3.4.14)  reduces  to  the  rigid  model  (3.4.9)  and  hence  we  are  justified  that 

u  0  is  the  rigid  control  applied  to  the  ideal  rigid  model. 

By  appending  a  corrective  control  .  u  t  =  u0  .  to  the  nominal  rigid  controller,  the  flexible  model 
will  behave  like  the  rigid  one  in  the  mid-frequency  range  where  O  (( fis  )2)  is  negligible. 

In  other  words,  applying 

u  =  i/0  +  fj.u  j  =  u0  +  p.u0  (3.4.15) 

to  the  realistic  flexible  system  will  make  the  flexible  system  performance  identical  to  the  rigid 

one  in  the  mid-frequency  range. 

Xote  that  (3.4.15)  in  the  frequency  domain  is 

U  =  (1  +  ns  )U„ 

which  is  equivalent  to  (3.4.13)  in  the  mid-frequency  range  where  0  (  (fis  ) 2  )  is  negligible. 

The  same  argument  can  be  applied  to  the  flexible  link  system  (3.3.2)  and  similar  result  can  be 
obtained. 

We  now  recapitulate  w'hat  we  have  done.  A  case  study  of  a  flexible  beam  system  reveals 
that  flexibility  causes  phase  delay  and  thereby  deteriorates  its  expected  performance  based  on  a 
rigid  model  assumption.  The  frequency  domain  analysis  comes  up  with  a  corrective  scheme 


which  is  equivalent  to  the  the  time  domain  approach,  where  the  integral  manifold  idea  is  used 
as  a  design  tool. 

3-5.  Case  Study  of  a  Mechanical  System  with  Flexible  Interconnection 

In  previous  sections  we  investigated  the  control  issue  of  flexible  link  robots  where  perfect 
rigidity  is  assumed  for  the  joints.  Due  to  the  deformation  of  gear  teeth  or  bearings  within  the 
joints,  we  also  have  to  face  the  control  problems  of  manipulators  with  elastic  joints.  Spong. 
Khorasani.  and  Kokotovic  model  the  joint  flexibility  in  the  rigid  link  manipulator  by  introduc¬ 
ing  a  fictitious  stiff  spring  within  the  joint  [6].  The  motor  shaft  is  interconnected  to  the 
relevant  link  through  this  spring,  which  becomes  a  rigid  connection  as  the  spring  constant 
tends  to  infinity.  In  this  section,  we  shall  study  the  modeling  of  a  mechanical  system  of  two 
interconnected  masses,  which  is  similar  in  principle  to  the  elastic  joint  modeling  in  [6]. 

Consider  the  mechanical  system  in  Figure  3-4  where  M  is  attached  to  a  reference  frame 
through  a  spring  with  spring  constant  ks  and  m  is  driven  by  an  external  force  f.  Masses  M 
and  m  are  interconnected  by  a  stiff  spring  with  spring  constant  k}  ,  and  x  and  z  are  the  dis¬ 
placement  associated  with  M  and  m.  respectively.  Viscous  damping  is  modeled  by  the  damp¬ 
ing  constants  D  and  B.  respectively. 

The  equation  of  motion  for  this  mechanical  system  can  be  written  as 

Mx  =  —ksx  —  kj  (x  —  z  )  —  B  (x  —  z  )  +  Mg  —  Dx  (3.5. l.a) 

mz  =  kf  (x  —  z  )  +  B  (x  —  i  )  +  mg  +  f  (3.5. 1  .b) 

where  (  .  )  and  (  ..  )  represent  the  first  and  second  derivatives  with  respect  to  time,  and  g  is  the 

gravitational  constant. 

Dividing  both  sides  of  (3.5.1)  by  mass 

ks  k!  B  D 

X  - - X - (x  -  r  ) - (x  —  r  )  +  g - x  (3.5.2.a) 

MM  M  M 

kf  B  .  / 

z  -  - (x  —  z  )  +  — (x  —  z  )  +  g  +  —  .  (3.5.2.b) 

mm  m 

Introducing  a  new  state  variable 
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y  =  kf  (x  —  :  )  .  and  k .  =  — -  . 

M‘ 


equation  (3.5.2.a)  becomes 


x  - - a; - y  —  fJi  — v  +  g - x 

M  M  M  M 


(3.5. 3.a) 


By  subtracting  (3.5. 2. b)  from  (3.5.2.a),  we  get 


,  ks  11  ,  1  1  D  .  / 

M'y  = - x  —  ( —  +  —  )y  —  fi  B( —  +  — )y - x - . 

M  Mm  m  Af  Mm 


(3.5.3.b) 


To  transform  our  system  into  a  standard  singularly  perturbed  linear  system,  we  use 


r  2  I  •  kv 


With  this.  (3.5.3)  becomes 

0 


* 1 

D 

*2 

M 

M 

B-y  i 

0 

0 

My  2 

“*« 

D 

M 

M 

0 

-1 

M 

0 

m  +  M 
mM 


B 

-M. — 
M 


(3.5.4) 


m  +  M 
mM 


For  a  stiff  spring  kf  is  a  large  constant  and  this  implies  fi  is  a  small  constant,  which  assures 
the  singularly  perturbed  form  in  (3.5.4).  As  kf  —  oo  ,  or  fj.  —  0  ,  our  mechanical  system 
becomes  the  one  with  a  rigid  connection  and  (3.5.4)  reduces  to 


D 

m  +  M  m  +  M 


g  + - 

m  +  M 


(3.5.5) 


with  the  use  of  equalities 


y  2  =  °  .  >’  i  =  ~ 


m  +  M  M 


k*  D  f  s 
(  - Xj  +  — x,  +  — ) 


obtained  by  setting  n  =  0  in  (3.5.4). 

Equation  (3.5.5)  is  the  system  description  for  the  rigidly  connected  mechanical  system  as 
shown  in  Figure  3-5.  where  we  have  a  single  object  with  mass  m  +  M  attached  to  the  inertial 
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kryru  * 


frame  through  a  spring  with  spring  constant  ks  and  damping  constant  D. 

[y, 


With  X  = 


*1 

X, 


and  Y  = 


(3.5.4)  can  be  written  as 


X 

1 f*r 


\A  n  A 
A  2i  A 


22 


(3.5.6) 


where  u  = 


0 

0 

g 

»  v  — 

m 

and 


^  22  ~ 


0 

m  +  M 


mM 


—fiB 


m  +  M 


mM 


is  nonsingular 


In  fact 


^22  ~ 


-MS  ~ 
1 


mM 


m  +  M 
0 


By  Corollary  2.2.2  there  exists  an  integral  manifold  Z  =  LX  +  P  for  (3.5.6).  The  constant  L 
and  the  variable  P  satisfy,  respectively. 


A  -> ^  4"  A  fJ,L  ( A  -b  A  12^  ) 

fj.P  =  (A  22  -  fJ-LA  p )P  +  (v  —  uLu  ) 


(3.5. 7.a) 
(3.5. 7. b) 


with 


L  —  L  0  +  (J.L  j  +  m  L  2  + 


P  =  S  Q  +  fJ.P  1  +  [l  P  2  +  • 


(3.5.8) 


Equation  (3.5.6)  as  restricted  to  the  manifold  becomes 

X  =  (AU+  A12L)X  +  (u  +  A  l2P  ) 

=  (.4  n  +  A  12L0)X  +  (k  +  A  12P0) 

+  mC‘4  i2L  iX  +  A  12PJ  +  /a  (A  l2L2X  +  A  1 2P2)  + 

Consider  the  case  where  f  is  a  constant  force,  such  as  a  mass  of  weight  f.  then  P  can  be  solved 

by  equating  coefficients  of  different  powers  of  m  on  both  sides  of  (3.5.7) 
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P,=  -A  ~lv 


Pi  ~  A  22  C/’o  P  tyA  Jii’o  +  P  t)u  ) 

-4  22  (  “  A  22  V  P  qA  12 A  22  V  A  L  ()U  ) 

P  2  ~  A  22  ( P  i  A  L  XA  jji5  q  +  P  lyA  ^P  l  PyP-') 

With  the  assumption  that  f  is  a  constant,  u  and  v  will  also  be  constants.  So  we  have 

P0  =  —A  22  v 

P  A  22 P  q(—A  12*4  22  v  +  u  ) 

P 2  —  A  22  (P  1 A  l2P o  +  P  <yA  l2P  1  +  L  ) 
where 

P  <.<  ~  ~A  22  A  21 

P  i  —  A  22  P  o(-“4  ii  +  A  l2P  0) 

P  2  A  22  (Pi  (A  ii  A  A  12  P  q)  4*  P  qA  12P 1  ) 
as  solved  from  (3.5. 7.a). 

Substituting  At]  by  corresponding  entries  from  our  mechanical  system  description  (3.5.4),  we 
have  the  relevant  coefficients  of  /j°  terms: 


^11  "*■  A  12P  0  — 


0 

kr 


D 


m  +  M  m  +  M 
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(jl  terms: 


a*4  y>L  I  “ 


m'mks(ks(m  +  A/ )  —  D~)  m  ~  D  (2k  s  (m  4-  A/  )  —  Z)  ) 


(m  +  A/  ) 


(m  +  Af  )4 


A  12P  2  - 


g  + 


j  m2(ks(m  +  M  )  —  D2) 


m  +  M  (m  +  M  ) 

Thus,  (3.5.8)  can  be  rewritten  as 


x  -  q  j(M) 


m  +  M 


+  q  2(m) 


2) 


m 


+  M 


+  ?  i(m) 


g  + 


/ 


m  +  M 


(3.5.9) 


with  0  (/a3)  terms  neglected  and 


?  ^/u)  =  1  +  /a' 


?2(m)  =  1  +  At" 


m2(ks(m  +M)  —  D 2) 

(m  +  M  )3 

2D(2k(m  +  M  )  —  D2) 


(m  +  M  )4 

By  using  a  scaled  variable  x  ^  =  x  /  q  t(/a)  (3.5.9)  becomes 


q  iCm)*,  q2^)D 


m  +  M 


■XM~ 


-**  + 


g  + 


/ 


m  +  M 


(3.5.10) 


m  +  M 

Note  that  with  /a  =  0  (3.5.10)  reduces  to  the  mechanical  system  with  a  rigid  connection  as 
described  bv  (3.5.5),  or 


D 


m  +  M 


m  +  M 


-x  + 


g  + 


/ 


m  +  M 


with  natural  frequency  o)0  -  my J  and  damping  ratio  £0  =  —  D‘ 


ksm  +  M 


m  +  M 

On  the  other  hand,  the  perturbed  system  (3.5.10),  i.  e..  the  one  with  a  flexible  connection,  can 
be  viewed  as  the  one  with  a  displaced  center  of  mass,  x  ^  =  x  /  q  j(/a)  ,  and 
perturbed  spring  constant:  q  l(n)ks  . 
perturbed  damping  ratio:  q  2(/x)D  . 
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natural  frequency:  oj  =  J 


m  +  M 


damping  ratio:  ^  q2  (m) 

ksq  ii/iXm  +  M  ) 

The  connected  system  as  a  whole  can  be  viewed  as  the  one  in  Figure  3-6  with  the  above  charac¬ 


teristic  constants.  Suppose  we  have  an  underdamped  system  in  the  rigidly  connected  case.  i.  e.. 


0  <  <  1  or  0  < 


(m  +  M  )kt 


For  \1  and  m  both  large  enough  as  compared  with  damping  constant  D.  we  have  q  j(/z)  >  1  and 


q  2(/u)  >  1  •  This  implies  that  the  mechanical  system  as  a  whole  has  an  increased  natural  fre¬ 


quency  and  damping  ratio  due  to  the  presence  of  flexibility.  i.e.,/i^O. 


3.6.  Conclusion 


Additional  fast  states  are  introduced  to  take  into  account  the  presence  of  flexibility  in  the 


manipulators.  The  resultant  system  is  a  singularly  perturbed  version  of  the  rigid  model  equa¬ 


tion.  Flexible  link  robots  are  shown  to  be  in  this  singularly  perturbed  form,  and  the  system 


equations  possess  an  integral  manifold.  We  indicated  and  proved  that  the  flexibility  is  a  cause 


of  phase  delay  which  induces  unsatisfactory  performance  in  the  nonrigid  robot  with  a 


presumed  rigid  modeling.  Frequency  domain  analysis  and  time  domain  analysis  using  the  idea 


of  the  integral  manifold  both  come  up  with  the  same  remedy  scheme  which  demands  an  addi¬ 


tional  corrective  control  be  appended  to  the  nominal  controller  to  compensate  for  the  phase 


delay.  Last,  we  extended  our  idea  to  an  interconnected  mechanical  system  which  contains 


flexible  joint  robots  as  a  special  case.  The  system  with  a  nonrigid  connection  is  shown  to  have 


a  perturbed  natural  frequency  and  damping  ratio  and  a  displaced  center  of  mass  from  that  of 


the  rigidly  connected  one. 


4.  TRACKING  AND  DISTURBANCE  REJECTION  IN  NONLINEAR  SYSTEMS 
BY  NONLINEAR  INTEGRAL  CONTROL 

4.1.  Introduction 

We  shall  investigate  the  tracking  and  disturbance  rejection  problem  of  a  class  of  time- 
invariant  nonlinear  systems  which  are  linear  equivalent  to  controllable  linear  systems.  By  using 
a  nonlinear  feedback  control  and  a  slowly  varying  integral  control  the  closed-loop  system 
asymptotically  tracks  a  reference  input  and  rejects  disturbances  which  are  both  unknown  and 
slowly  varying.  The  Integral  manifold  concept  will  be  used  to  design  a  nonlinear  integral  con¬ 
troller. 

The  so-called  PI  controllers  have  been  used  extensively  for  asymptotic  tracking  of  con¬ 
stant  but  unknown  set-point  and  rejection  of  constant  disturbances.  For  linear  time-invariant 
controllable  systems  with  nonlinear  output.  Smith  and  Davison  showed  that  a  full  state  feed¬ 
back  plus  an  integral  control  are  needed  to  achieve  the  asymptotic  tracking  and  disturbance 
rejection  with  the  resultant  closed-loop  system  remaining  stable  [24],  By  using  a  small 
integral  gain  Kokotovic  pointed  out  that  in  a  linear  time-invariant  system  the  effect  of  the 
integral  control  is  to  counteract  the  disturbance  terms  [13].  For  nonlinear  systems  Desoer  and 
Lin  proved  that  a  PI  controller  can  be  used  to  asymptotically  track  reference  inputs  and  reject 
disturbances  provided  that  the  given  system  is  exponentially  stable  and  has  a  strictly  increasing 
dc  steady-state  I/O  map  [25]. 

In  this  chapter  we  study  the  tracking  and  disturbance  rejection  for  a  class  of  nonlinear 
systems  which  are  equivalent  to  linear  controllable  systems  through  a  diffeomorphism  of 
change  of  coordinates  and  external  feedback  linearization.  Once  the  given  system  is 
transformed  to  its  linear  equivalent,  it  is  first  of  all  stabilized  by  using  a  full  state  feedback. 
A  slowly  varying  integral  cornrol  is  then  applied  for  the  purpose  of  disturbance  rejection  and 
asymptotic  tracking.  The  overall  system  consists  of  a  fast  linear  subsystem  governing  the 
states  of  the  given  plant,  and  a  slow  nonlinear  differential  equation  governing  the  variation  of 
the  integral  control.  We  will  show  that  there  exists  an  integral  manifold  for  the  overall 


system.  By  stabilizing  the  linear  equivalent  system  the  integral  manifold  for  the  overall  sys¬ 
tem  is  rendered  attractive.  Finally  we  show  that  when  the  system  reaches  the  equilibrium 
somew here  on  the  slow  manifold,  asymptotic  tracking  of  reference  input  is  then  accomplished. 


We  start  by  reviewing  some  concepts  in  differential  geometry  and  external  feedback 
lineanzaton.  and  also  by  giving  a  description  of  our  problem.  To  facilitate  our  discussion  we 
shall  consider  the  set-point  problem  alone  in  Section  4.4.  Later,  with  some  additional  assump¬ 
tions.  we  continue  our  analysis  in  Section  4.5  when  an  unknown  but  constant  disturbance  is 
also  present.  The  result  is  extended  to  slowly  varying  unknown  reference  input  and  distur¬ 
bance  in  Section  4.6.  Finally,  in  Section  4.7.  we  illustrate  our  methodology  by  a  second-order 
example  which  is  unstable  and  has  a  nonzero  output  at  the  origin. 


4.2.  Some  Useful  Concepts  of  Differential  Geometry 

The  Lie  bracket  of  two  C°°  vector  fields  on  Rn  ,  f  and  g.  is  defined  by 


/  g 


s*Lf  -*L 

d*  dx 


U  T  U. 

w  here  —  and  -  are  n  X  n  Jacobian  matrices  and 

6*  Qx 


/  -g 


is  itself  a  vector  field  on  . 


Successive  Lie  brackets  are  denoted  bv 


ad)  (g  )  = 


/  .  ad)  -1(g  ) 


ad  fig  )  =  g 

A  set  of  C°°  vector  fields  { /  x  ,  .  .  .  .  f  m  |  on  R "  is  said  to  be  involutive  if  there  exist  C°° 

functions  a  .  (x  )  such  that 

*  /*■ 


f,  •  / 


U)  = 


L  a,jk (x )  f  <  ) 


l^i  .  j  ^  m  . 


L  =  1 

Suppose  f  x . f  m  are  linearly  independent  on  Rn  .  \j  x . f  ,n\  is  said  to  be 

completely  integrable  if  there  exists  an  m-dimensional  submanifold  M  in  R "  such  that  at  each 
point  of  M  the  tangent  space  of  M  is  spanned  by  {/  x . f  m  }  . 
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For  ft:  R  — *  R  .  the  gradient  of  0  is  a  row  vector 


d  Cl  ={  - — . —  ). 

3*  1  d*n 

The  dual  product  of  d  n  and  a  vector  field  g  —  (  g  j . gn  )T  is  a  scalar  field  denoted  by 

aft  aft 

<d  ft  .  g  >  =  - g  !  + . +  - g„  ■ 

dx  i  dx„ 

With  this  notion,  complete  integrabilitv  of  {/  x  ,  .  .  ,  f  m  }  can  also  be  deduced  from  the  fol¬ 
lowing  fact. 

A  set  of  vector  fields  on  R"  .  { f  { . f m)  .  is  completely  integrable  if  and  only  if 

there  exist  n-m  linearly  independent  functions  /j  j(.t  ) . hn  _m  (x  )  such  that 

<dht  (x  )  .  f  j  (x  )  >  =  0  ,1^£  ^  n  —  m  ,  1  ^  j  ^ m  for  all  x  €Rn 

With  the  concepts  of  involutiveness  and  complete  integrabilitv  we  now  state  the  well-known 

Frobenius  Theorem. 


Frobenius  Theorem:  A  set  of  linearly  independent  vector  fields  {  /  j  ,  .  .  .  ,  f  m  }  is  com¬ 
pletely  integrable  if  and  only  it  is  involutive  [26]. 


O’ 


We  are  concerned  with  the  class  of  nonlinear  system 

x  =  /  (x  )  +  g  (x  )  u  .  x  6  R  ‘  ,  u 

which  is  equivalent  to  a  controllable  linear  time-invariant  system  (4.2.1)  after  external  feed¬ 
back  linearization 


v  =  Ay  +  Bv  .  y  6  Rn  ,  v  e  R  .  (4.2.1) 

From  [27]  necessarv  and  sufficient  conditions  for  the  local  existence  of  such  a  transformation 


(i)  f(0)  =  0. 

( ii)  the  controllability  matrix  g  .  ad  /  (g  )  .  .  .  ,  ad*  1  (g  )  span/?-1  about  the  origin. 

(iii)  the  set  of  vector  fields  I  g  .  ad  *  (g  ad,  “  (g  )  ]  is  involutive. 
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Before  we  state  the  conditions  for  the  global  existence  of  such  a  transformation,  we 
integrate  along  the  involutive  distribution  {  g  .  ad}  (g  )  ,  .  ,  ad}  (g  )  }  . 

(1)  Solve  for  all  ft  €  R  the  system 


-ad}  1  (g  )  .  x  (0)  =  0 


(4.2.2  a) 


and  obtain  the  solution  x(  ft  ). 


(2)  Solve  for  all  Jj  €  R  the  system 


dx  , 

-  -  ad  f  ‘(g)  .  x(ft,0)  =  x(ft) 

d91 


(4.2.2.b) 


and  obtain  the  solution  x(  ft  ,  91  ). 

(3)  Obtain  the  solution  x  (  ft  ,  91  .  92)  for  all  92  €  R  the  system 


-  =  ad}  (g)  ,x(ft  ,0.  ,0)  =  x(ft  .0,) 

d92  1 


(4.2.2.c) 


(4)  Repeat  in  this  manner  until  we  obtain  the  solution  x  (ft  .  ,  .  .  .  ,  9n  _  j)  for  all 

9n  ~x€R  the  differential  equation 


-1 


~g  .x(n.9j . 9n  _2 , 0)  =  x(ft  .  9X . 0„_2)-  (4.2.2.d) 


Carrying  out  the  above  procedure  we  have  the  map 

M:  X  =  (x ! . x„  )  -*  ( ft  .  0, . 0„  _  j) 

which  has  a  Jacobian  matrix,  or  the  noncharacteristic  matrix 


J{x  )  = 


.  6*  i  8*  i 

8«  80, 


8*„  8*„ 


86. 


8n  80!  80,-i 

The  conditions  for  the  global  existence  of  the  inverse  of  map  M  is:  [28] 

there  exists  a  constant  p  >  0  such  that  the  absolute  values  of  the  leading  principal  minors 


V  ■J'VW  VV  W 


I 

Pi 


Aj  .  A3  .  .  .  A,;  of  J(x)  satisfy  the  ratio  condition 

,  I  I  I  | 

|  Aj  I  ^  p  .  -  ^  P .  .  ^  p 

I  Ai |  I  A„  _  j | 

for  all  x  €  Rr‘  .  The  scalar  At  is  defined  to  be  the  determinant  of  the  matrix  obtained  by 
deleting  the  last  n  —  k  columns  and  rows  of  J. 

\ow  we  are  ready  to  state  the  conditions  for  the  global  case.  Proof  can  be  found  in  [28], 
Theorem  4.2.1 

x  =  f  (x  )  +  g  (x  )  u  is  globally  transformable  to  y  =  Ay  +  Bv  with  external  feedback  linear¬ 
ization  if 

(0  the  controllability  matrix  g  (x  )  .  ad /(g  (.t  )).-••.  ad"  *(g  (x  ))  is  nonsingular 
on  R"  . 

(ii)  the  set  {g  (x  )  .  adf{g  (x  )),  ■  ■  ■  .  ad*  2(g  (x  ))>  is  involutive  on  R"  .  and 

(iii)  the  noncharacteristic  matrix  satisfies  the  ratio  condition  on  Rn  . 

4.3.  Problem  Formulation 

A.  System  description 

Consider  the  S1SO  feedback  system  as  shown  in  Figure  4-1,  where  P  is  the  given  non¬ 
linear  plant.  Scalars  c,  and  S  are.  respectively,  the  plant-output  disturbance  and  plant-input 
disturbance.  The  scalar  c  is  the  reference  input.  The  variables  u  and  y  are.  respectively,  the 
input  and  the  output  of  the  plant  P.  The  controller  F  takes  E.  the  error  between  the  output  of 
the  plant  and  that  of  the  reference  input  plus  plant-output  disturbance,  and  produces  u  that  is 
to  be  fed  into  the  plant. 

The  nonlinear  plant  P  with  input  u.  state  x,  and  output  y  is  described  by  the  following 
equations: 

x  =  /  (x  )  +  g  fx  )  u  (4.3.1) 

y  =  T)(x  )  (4.3.2) 

where  x  €  A?"  .  y  €R  .  and  u  €/?  .  The  controller  is  to  be  designed  such  that  the  closed-loop 


system  performs  asymptotic  tracking  and  disturbance  rejection  for  all  given  initial  conditions 
and  for  all  inputs  and  disturbances  satisfying  our  assumptions. 

B.  General  assumptions 

The  following  assumptions  are  assumed  to  be  satisfied  throughout  this  chapter. 

A4.3.1:  /  :Rn  -»  Rn  and  g  :  Rn  —  Rr  are  such  that  the  system  x  =f  (x  )  +  g  (x  )  u  is  glo¬ 
bally  feedback  linearizable. 

A4.3.2:  7 y.Rr'  —  R  isaC'  function  . 

A4.3.3:  The  reference  input  c  .  the  plant-input  disturbance  5  .  and  the  plant-output  distur¬ 
bance  c ,  are  all  scalar  constants  (see  comments  below).  We  will  assume  =  0  .  and  hence 
E  x  =  E  .  since  its  effect  can  be  included  in  c  in  the  closed-loop  system. 

A4.3.4:  The  states  of  the  given  plant  are  available  for  full-state  feedback. 

Comments: 

From  Theorem  4.2.1.  Assumption  A4.3.1  is  required  so  that  our  nonlinear  system  can  be 
transformed  into  a  linear  controllable  system  by  diflfeomorphism  and  external  feedback  linear¬ 
ization.  Since  f  and  g  are  both  smooth  functions,  it  therefore  guarantees  the  existence  of  a 
unique  solution  for  our  plant  (4.3.1)  for  all  t  ^r0  with  any  given  initial  condition  x0  and  ini¬ 
tial  timer,,.  Homogeneity  only  serves  to  ease  our  discussion  and  is  not  necessary.  If  (xc  ,  ue ) 
is  the  equilibrium  of  (4.3.1).  i.  e. ,  /  (x, )  +  g  (x,  )uf  =0  ,  a  change  of  coordinates 

x  =  x  —  xf  .  u  =  u  —  ue  .  will  bring  us  back  to  a  homogeneous  system.  Note  also  the  require¬ 
ment  of  7]( 0)  =  0  as  demanded  by  Desoer  and  Lin  is  not  required  here  [25].  For  reference 
input  and  disturbance  varying  at  a  rate  of  O(e')  .  0  <  e  «  1  ,  our  methodology  can  still 
achieve  asymptotic  tracking  and  disturbance  rejection  up  to  0(e)  neighborhood  of  the  perfect 


4.4.  Asymptotic  Tracking  of  an  Unknown  Constant  Reference  Input 
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Assuming  that  there  is  no  plant-input  disturbance,  i.  e.,  u  =  u  ,  we  shall  show  that  a 


nonlinear  feedback  control  plus  an  integral  control  will  achieve  asymptotic  tracking  of  the 


constant  set-point  problem. 


(l)  External  Feedback  Linearization 


We  seek  a  change  of  coordinates  for  (4.3.1)-(4.3.2): 


T:  R"  -  Rn 


T(x)  =  r 


where  T  is  a  C  ^  diffeomorphism  and  in  the  new  local  coordinates  there  exists  a  function 


Cl:  Rn  -  R 


such  that 


Ls  Q(x)  =  0 


LALf  fl(x))  =  0 


(4.4.1) 


L,  (L"f  2O(x))  =  0 


LAL*  1fKx))^0 


(4.4.2) 


where  L„  Cl  represents  the  Lie  derivative  of  along  the  vector  held  g. 


an 

Lras<  —  ,g  > 

6* 


<  .  .  >  denotes  dot  product. 


It  can  be  shown  that  the  Q  variable  we  obtained  in  integrating  along  the  involutive  set 


{ g  (x  ).  ad }(g  (x  )).■■■,  ad"f  2(g(x))|  as  in  Section  4.2  satisfies  (4.4.1)-(4.4.2)  [28],  We 


shall  define  the  new  local  coordinates  by  the  following  C°°  diffeomorphism  from  the  old  ones. 


z  2  Lf  (l(x)  T- ,(x  ) 


=  T  (x  ) 


li;_1n(x)J  X(x)1 

We  then  have  the  following  equivalent  system  from  (4.3.1): 


-  1  -  2 

-  2  =  -  3 


^  i  —1  “ n 

zn  =i;n(x)  +  xa;_1n(x))u 
=  F(x)  +  GU)u  . 

We  shall  show  that  a  nonlinear  feedback  control  of  the  form 

u  =  G  (Uj  +  k  -  +  v  ) 
will  achieve  asymptotic  tracking  of  the  unknown  set-point. 

Pick  Uj  =  —  F(x  )  .  (4.4.4)  becomes 

0  1  0  ...  0 


0  0  1  ...  0 

0 

0 

0  0  0  ...  0 

r  + 

0  0  0  ...  1 

0  0  0  ...  0 

0 

1 

(4.4.3) 


(4.4.4) 


(4.4.5) 


(4.4.6) 


which  is  a  standard  linear  controllable  system. 

Observe  that  this  external  feedback  linearizing  technique  requires  full-state  feedback  and  also 
the  nonsingularity  of  G(x)  .  We  can  carry  out  the  pole  placement  design  or  stabilization  of  the 
system  once  we  have  our  system  transformed  into  (4.4.6). 


Hunt,  Su,  and  Meyer  had  shown  that  conditions  for  the  global  existence  of  G_1  and  a  C°° 
transformation  (4.4,3)  are  equivalent  to  Assumption  A4.3.l[2S],  Similar  argument  for  feed¬ 
back  linearization  can  also  be  found  in  other  books[29.  30], 

(2)  Stabilizing  the  linearized  system 

We  now  apply  a  feedback  control  u2(z  )  to  stabilize  the  linear  system  (4.4.6). 

n  n 

u2  =  Z>,-,=  LaJi(x'>  (4.4.7) 

1=1  .=1 

where  a,  's  are  chosen  so  that  the  resultant  system  matrix  is  Hurwitz,  i.  e..  the  characteristic 
polynomial 

n  n  — 1  n  —2  -  s  *  *  a\ 

s  - ans  “  oin  _i 5  —  ...  -  =  0  (4.4.8) 

has  all  roots  with  negative  real  parts. 

With  u  t  and  u2  the  given  system  becomes 

0  1  0  ...  0 


dz 

0  0  1. 

0  0  0. 

o  o  < 

Z  + 

0 

0 

d  r 

0  0  0. 

“l  a2  a3 

.  1 

■  an 

0 

1 

=  Az  +  Bv  .  (4.4.9) 

We  shall  study  the  behavior  of  the  overall  system  when  v  is  an  integral  control  governed  by 

dv 

-  =  6  T(E(z  )  ,  v  .  e)  (4.4. 10. a) 

d  r 

r(0.v,€)  =  0  (4.4. 10. b) 

where  T  is  a  smooth  nonlinear  function  to  be  designed  .  E  is  the  tracking  error  .and  e  is  a 

small  positive  number.  The  equivalent  system  is  as  shown  in  Figure  4-2. 

Remark:  When  €  =  0  .  v  =  v(0)  becomes  a  constant.  By  the  nature  of  Hurwitzness  of  the 
system  matrix  A  the  states  z  remain  bounded  despite  the  presence  of  v,  which  acts  as  a  con¬ 
stant  disturbance  to  the  system  (4.4.9). 


( 3 )  Change  of  time-scale  and  the  existence  of  integral  manifold 


We  now  define  t  —  er  as  the  slow  time  scale.  In  the  slow  time  scale,  (4.4.9)-(4.4.10) 
will  be  in  standard  form  for  the  integral  manifold  discussion  as  in  Cl. 2.1). 

dv 

—  =  r (E(z  )  .  v  .  e)  (4.4.11) 

dt 

dz 

€ —  =Az+Bv  (4.4.12) 

dt 

It  is  easy  to  check  that  the  conditions  in  Section  1.2  for  the  existence  of  the  integral  manifold 
for  (4.4.1 1 )-( 4.4. 12)  are  satisfied. 

Ml:  A:  +  Bv  =  0  gives 

J2  =  f3  =  ...  =  jn  =  o  (4.4.13) 

and 


z1  -  —  v/aq  .  (4.4.14) 

Xote  that  in  (4.4.14)  aq  tA  0  since  if  oq  =  0  (4.4.8)  will  have  a  zero  root  contradicting  the 

fact  that  all  of  its  roots  have  negative  real  parts. 

M2:  Trivial. 


M3: 


Re 


X,  (.4  ) 


<  0  .  1  ^  i  ^  n 


where  (A  )  stands  for  the  eigenvalue  of  the  matrix  A. 
Trivial  bv  (4.4.8). 


Hence,  there  exists  an  integral  manifold  of  the  form  z  ~  h  (v  ,€)  for  the  system 
(4.4. 1 1 )-( 4.4. 12). 

h  (v  .  €  )  =  h°(v  )  +  eh  '(v  )  +  ...  (4.4.15) 

h  (v  .  €  )  can  be  found  by  the  fact  that  it  satisfies  (4.4.1 1)-(4.4. 12),  i.  e., 

dh 

€  —  v  =  Ah  (v  ,  e)  +  Bv  (4  4  16) 

av 

Using  MAE  (  Matched  Asymptotic  Expansion  ).  we  equate  coefficients  of  successive  powers  of 


I 


1 


I 


€  on  both  sides  of  (4.4.16) 


e°:  0  =  Ah  °(v  )  +  Bv 

3r 


gives 


0  1 
0  0 
0  0 


0  o 

al  a2 


Coefficients  of  e1  terms  in  (4.4.16): 
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where 


is  a  C*  function. 


71(x)  =  71(r~1(.'))  =  w(z) 


W  =  7)  o  T 


The  error  between  the  plant-output  and  that  of  the  reference  input  in  z-coordinates  is 

E  —  w  (z  )  —  c 

which,  when  the  system  is  on  the  integral  manifold,  becomes 

E  =  w  (h  (v  ,  e))  —  c  . 

Note  that  since  we  are  working  on  a  constant  set-point  problem  for  the  time  being,  the  mani¬ 
fold  is  of  the  form  z  —  h  (v  .  e). 

Since  w  6C‘  ,  we  can  use  the  chain  rule  of  differentiation  and  obtain 


dw  0w  Qz  dv  Qw  $h  dv 

dt  Qz  0v  dt  Qz  Qv  dt  \z  =  a  (v  ,«) 


0w  Qh  _  0w  9*  i^v  •  «)  0w  dh»  (v  • 

3z  qv  azt  av  9c„  9v 


Recall  from  (4.4.18)  we  have 


r1/or 


4- 0(e) 


Therefore. 


8 

a 

Si 

& 


(4.4.19) 


aw  qa  -i  aw  . 

- = -  .  +0(e)  .  (4.4.19) 

0c  0v  al  0c  i  |z  =(-v/0)  .o  .  o y 

For  €  small  enough  we  further  propose  the  following  assumption  to  assure  the  nonsingularity 
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Qm'  3^ 

of - when  the  svstem  is  on  the  integral  manifold  :  =  h  (v  ,  e)  . 

a-  dv 

Assumption  A4.4.1: 

i  3W  i 

The  choice  of  diffeomorphism  T  has  the  property  that  | - 1 

0^!  |z  *(-v/o1 .0. 

formly  in  v.  where  w(z)  =  r\(T  *(z  ))  =  7}(.r  )  is  the  plant-output. 

With  this  assumption  and  the  fact  that 

aw  Qh  Qw  3^  i^v  •  0w  dhn  (v  •  €) 

qz  av  a-i  av  av 


=  0(1)  uni- 


where 


a*  i 

I — l  =  |i/°il 

3V 

=  0(e)  2  ^  i  ^  n 


we  have 


0W  Qh 

- =0(1)  uniformly  in  v. 

3-  0v 

This  in  turns  ensures  that  w  o  h  is  a  bijective  mapping.  Hence  one  and  only  one  plant-output 
will  achieve  the  perfect  tracking  for  each  reference  input. 

Remark:  The  same  assumption  is  made  by  Desoer  and  Lin.  who  claim  the  implicit  existence  of 
the  function  h  which  is  made  explicit  by  us  [25]. 


Using  the  update  law. 


dv  0w  fth 

dt  0z  0v 


(w  —  c  ) 


(4.4.20) 


dw  ,  . 

w  here  -  is  understood  to  be  evaluated  at  z  =  h  (v  .  e)  . 


we  then  have 


-  =  -  (w  -  c  )  =  -£ 

dt 


(4.4.21) 
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Solving 


'  (t  )  =  c  +  (w  (0)  —  c  )  ( 


Or 


E(t  )  =  E (0) e  '  . 

Therefore,  the  tracking  error  goes  to  zero  asymptotically. 

Thus,  the  nonlinear  differential  equation  governing  the  desired  integral  control  is  given  by 

i  -l 

+  0(e).  (4.4.22) 


dv 

~  E 

Qw  Qh 

a  r 

i  aw 

dt 

Q-  dv 

lL 

a,  6-i 

Or.  in  the  r  time  scale. 


dv 


—  ea. 


d  T 


3" 


d- 1 


E  +  0(6*)  . 


(4.4.23) 


0VV 


The  assumption  on  — —  being  uniformly  bounded  from  below  preserves  the  two-time  scale 
a--i 


property  in  the  overall  system. 

The  overall  system  will  finally  converge  to  the  uniformly  asymptotic  stable  equilibrium 
(:c  .  vr  )  that  satisfies 


0  =  E  =  w{h  (v  .  e))  —  c 


dh 


0  =  e  —  T(0  .  v,  ,  e)  =  A:e  +  Bvt  . 


(4. 4. 24. a) 
(4. 4.24. b) 


Solving  (4.4.24),  we  obtain  the  equilibrium  point  given  by 

vf  =  (w  o  h  )  1  (c  ) 


-  =  h  (v  ,  €)  =  -.4  "!5v-  = 


-ve  /«! 


We  have  shown  that  for  any  given  initial  conditions  the  closed-loop  system  will  converge 
asymptotically  to  the  integral  manifold  due  to  its  global  region  of  attraction.  The  motion  on 
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o 


<* 


$ 


■? 


y. 


v 

N* 

A‘ 


s 


v 

V 


y> 


V, 


the  manifold  is  governed  by  (4.4.23).  which  also  converges  asymptotically  to  its  equilibrium 
point  with  bounded  plant  states  and  a  zero  tracking  error.  To  summarize  our  result,  we  have 
the  following  theorem. 

Theorem  4.4.1: 

The  nonlinear  plant  x  =  /  (x  )  +  g  (x  )  u  with  output  y  =  T)(x  )  will  achieve  asymp¬ 
totic  tracking  of  an  unknown  constant  set  point  for  all  initial  conditions  (x0  ,  t0  )  if  a  control 
of  the  form  u  =  O  1  (u  ^  +  u2  +  '' )  is  applied,  where 
(a)  G(x)  =  Lg(Lf  1  ( -x  ) )  ul  =  —  Fix)  .  and  F  (x  )  =  Lj  Q(x  )  where 
Cl:  R  ‘  —  R  is  a  scalar  field  that  satisfies 


0  — —  g  (x  )  .  ad}g  (x  ) 

. adnf  2g(x)  =  (0  , 

.  ,  0)  for  all  x  €  Rn  ,  and 

0* 

ii)  — —  ad  1  lg  (x  )  ^  0 

3-r 

for  all  x  €  Rn 

n 

(b)  u2  -  Xa,  r,  where 

i  =t 


n(*) 

Lf  Cl(x  ) 

-  =T(x)  = 

L,~ln(x ) 

and  a,  s  are  such  that  for 

/  \  ft  n  —  1 

P  U  )  =  S  “  Otn  S  “  .  — 

p(s)  has  all  roots  with  negative  real  parts. 

(c) 

-l 

dv  0w  Qh 

dT  ^  \z  -  h  (v  .«> 

E  =T\{x)  —  C  ,  W  =7)Or_1 

€61  0  .  €  ]  .  €  is  a  small  positive  number  that  satisfies  Lemma  4.4.1  to  ensure  a  globally  attrac- 
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tive  manifold.  The  scalar  E  is  the  tracking  error. 

Remark:  W  ith  our  methodology  exponential  stability  as  demanded  by  Desoer  and  Lin  for  a 
constant  input  u  in  the  system.  x~f(x)  +  g(x)u  ,  is  not  required  [25].  One  choice  of  the 
scalar  field  Cl  can  be  obtained  by  integrating  along  the  involutive  set 
(g  (x  )  ,  ad'{g  (x  )),•■•  ,  ad"  -2(g  (x  )))  as  in  (4.2.2)  Section  4.2.  Our  result  here  is  global. 
For  the  local  case  the  assumptions  need  only  be  satisfied  on  the  domain  of  interest  instead  of 
the  whole  Rn  space. 

<3w  (3 h 

With  Assumption  A4.4.1  on  the  uniform  boundedness  of  — - and  a  small  integral 

a-  av 

gain  €  .  we  have  the  following  Corollary. 

Corollary  4.4.1 

Asymptotic  tracking  and  disturbance  rejection  for  the  nonlinear  plant  x  =  f  (x  )  +  g  (x  ) 
with  nonlinear  output  y  =  r)(x  )  can  be  achieved  if  a  control  u  =  G  1  (u !  +  u2  +  v  )  is  applied. 
The  functions  /  .g.G  .  u  j  .  u2  .  and  t)  are  as  in  Theorem  4.4.1  and 

-l 

dv  Qw 

-  =  ea{E  - 

^  T  1  |  2  =  (-,  /<*  .  0 .  «)r 

where  €  €  (0  .  e]  .  0  <  €  «  1.  E  is  the  tracking  error. 

Proof: 

dw  $w  Qh  dv 

dt  Qr  Qxb  dt  |-  =a(v  .«) 


dv 

Qw 

a*t° 

— i 

0w 

- =  -eE 

=  6Qj£ 

d  T 

&  l 

av 

|  z  =  (-  —  .  0  . 
a 

.0)- 

a--. 

z  =  '->  /Oj  ,  o.  .  oy 


and  the  fact  that 


a- a*_=  cw 

a-  av  a-i  qc 


+  e^Cv  .  e) 


We  have 


mm 


dw  $w  dv 
d  r  6-  Qv  t 


Qw  Qh 

Qw 

dh  r 

dz  c>v 

0Z  i 

0v 

=  — €  (/  +  6  0(v  .  e))£ 


Recall  £  =  vv  —  c  ,  we  thus  have 


=  -e  (7  +  6  0(v  .  e))  E  . 


(4.4.25) 


With  0(v  .  e)  being  uniformly  bounded,  there  exists  a  6  such  that  for  all  €€(0.1]  (4.4.25)  is 
u.a.s..  So  with  €  =  Min  [e  .€],£— 0  as  t-*oo. 

QED 

4.5.  Disturbance  Rejection 

We  now  impose  a  constant  but  unknown  disturbance  S  in  our  plant-input  as  shown  in 
Figure  4-1.  The  actual  system  is 

x  =  f(x)  +  g(x')u 

where 

u  =  u  +  8  . 

In  the  new  local  coordinates  described  bv  (4.4.10) 


r,  =  F(x  )  +G(x  )u 

where  F(x)  and  G(x)  are  as  defined  in  (  3.11). 
When  we  first  apply 
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ft 
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5m 

% 

•Ih! 

Pill 

r 

1*4 

« 

£ 


2 

3 


it  results  in 


u  !  =  —Ft x  ) 


za  =  G  (x  )  S  =  G  (T  u  ))  8 


With  u  2  and  v  also  taken  into  consideration,  the  overall  system  becomes 

0  1  0  ...  0 

0  0  1  ...  0 

0  0  0  ...  0 

—  =  '  r  +  .  (v  +  SG  (T~1(z ))) 

dr .  .  . 

0  0  0  ...  1  ° 

1 

<*t  <*2  <*3  •  • 

dv 

-  =  €r(£  .V  .  e)  . 


(4.5. l.a) 


(4.5.  l.b) 


We  now  propose  the  following  assumption. 

Assumption  A4.5.1:  The  plant-input  disturbance  is  an  unknown  but  small  constant. 

With  A6  we  check  the  conditions  for  the  existence  of  an  integral  manifold  for  (4.5.1). 

Ml:  setting  the  RHS  of  (4.5. l.a)  to  zero  gives 

Z  2  =  -  3  “  ■■■zn  =  0 

a,J,  +  v  +  5  G  (T~\zl  ....,  0))  =  0  (4.5.2) 

By  the  implicit  function  Theorem  for  8  small  enough  (4.5.2)  has  a  unique  solution  given  by 


r  !  =  —  v  /al  +  O  (8)  . 


M2:  Trivial. 


M3:  Taking  the  partial  derivatives  with  respect  to  z  on  the  RHS  of  (4.5. l.a)  and  evaluate  it  at 
r  =  h"(v  )  gives 


W.  B?  f'J  feVJ  tel  G&S  71  J  1  B  £&  K*  SSM  •  ?,V  3  H 


1  0 
0  1 
0  0 


0 

0 

0 


0  0  ...  1 


0  1  0 
0  0  1 
0  0  0 


.  0 

.  0 

.  0 


0  0  0.1 


ai  +  Si  a2  +  S2  +  s3  •  •  •  an  +  &n  a,  a2  a3  .  .  .  an 


where 


=  S 


3G(r  \z)) 

& 


{z  =  h  %■  ) 


and  h°(v)  is  as  in  Ml.' 

The  characteristic  polynomial  of  the  perturbed  system  matrix  (4.5.3)  is  given  by 

Pis  )  ~  s  -  an  s  -  -  aj  . 

With  Assumption  A4.5.1.  we  now  carry  out  the  root  sensitivity  analysis  for  (4.5.4) 
Suppose  P(s)  has  roots  given  by 

P(K, )  =  0  .  1  ^  l  4n  , 

i.  e.. 

Pi  \  n  n “  1 

U  )  =  s  -  ans  -  .....  - 

n 

=  n>  -  v  ■ 

;=i 

Denoting  AA,  and  Aat.  as  the  perturbed  part  of  A,  and  at.  respectively,  we  have 

" 

AA,  =  £ - Aat  . 

*  =i  8®* 


(4.5.3) 


In  our  case  here 
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'•Vi 


Aaq  =  O  (S)  .  1  ^  k  ^  n 


BP  BP  ^ 
Bak  QX,  BQk 


where 


=  -  n  ~  K  ) 


/  =1  . /  ;*  / 


Thus. 


3X<  _  j^L  j>£_ 

cK  0X,  3a;  |  j  =  \ 

/ 


n  (x,-x;) 


(4.5.6) 


/ =1 ,  /  *  i 


From  (4.5.5)-(4.5.6)  it  is  seen  that  if  we  do  not  have  tightly  clustered  roots,  which  can  be  done 


by  eigenvalue  placement  at  our  disposal  as  in  (4.4.14).  the  perturbed  system  matrix  in  (4.5.3) 


will  still  remain  Hurwitz.  Hence,  the  existence  of  an  integral  manifold  is  still  guaranteed  and 


the  rest  of  the  argument  is  similar  to  that  in  Section  4.4. 


Remark:  Suppose  the  plant-input  disturbance  8  is  not  restricted  to  a  small  perturbation  and 


the  integral  control  is  a  constant  v(f  )  =  v(0)  ,  but  somehow  the  closed-loop  system  remains 


exponentially  stable  as  assumed  by  Desoer  and  Lin  [25].  In  order  that  our  methodology  be 


feasible  in  this  case,  we  require  the  existence  of  a  unique  solution  z  j(v  )  to  (4.5.2)  so  that  the 


existence  of  an  integral  manifold  for  our  system  is  assured.  This  is  equivalent  to  the  assump¬ 


tions  made  by  Desoer  and  Lin  for  the  existence  of  a  C1  function 


h  :  R  Rn 


such  that 


=  h  (v  ,  e)  for  all  v  6  R 


/here  (v  .5)  is  the  equilibrium  point  for  the  closed-loop  system  and  w  oh  is  a  bijection 


mapping  as  deduced  from  Assumption  A4.4.1. 
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In  other  words,  an  alternative  assumption  for  disturbance  rejection  is  the  following: 

Assumption  A4.5.1.a: 

(i)  The  disturbance  S  is  a  bounded  constant  that  gives  a  bounded  solution  z  (r)  in  (4.5.1)  for 
all  constant  v  and 

(ii)  ajZj  +  v  +  S  G  (T  *(?  t  ,  0  .  •  ■  •  ,  0))  =  0  has  a  unique  solution  z  L  =  z/v  ,  8)  . 

\ote  for  5  small  enough  the  above  assumption  is  always  satisfied.  With  this  assumption 
it  can  be  shown  that  the  existence  of  an  integral  manifold  z  =  h  (v  .8)  is  still  satisfied  and  the 
rest  of  the  argument  is  similar  to  that  in  Section  4.4. 

We  have  shown  how  a  class  of  linear  equivalent  nonlinear  system  can  achieve  asymptotic 
tracking  and  disturbance  rejection  for  any  given  initial  conditions  by  external  feedback  lineari¬ 
zation  and  the  integral  manifold  approach.  The  nonlinear  system  x  =  f  (x  )  +  g  (x  )  u  is  first 
transformed  into  a  stable  linear  system  z  =  .4z  +  Bv  by  a  nonlinear  feedback  and  the  use  of 
new  local  coordinates,  z  =T(x)  .  An  integral  control  of  the  form  v  =6T(.E  ,  v  ,  e)  is 
adopted.  The  concept  of  integral  manifold  is  then  used  to  design  the  integral  control  and  prove 
that  the  plant-output  asymptotically  tracks  the  given  reference  input  and  simultaneously 
rejects  disturbance. 


4.6.  Asymptotic  Tracking  and  Disturbance  Rejection  of  Slowly  Varying  Unknown 
Signals 

We  now  consider  slowly  varying  unknown  bounded  signals  as  our  reference  input  and 
disturbance.  By  using  the  integral  manifold  concept  we  shall  show  how  the  asymptotic  track¬ 
ing  can  be  achieved  when  some  extra  assumptions  are  satisfied.  The  overall  system  is  given  by 

x  =/(x)  +  g(x)(u  +  8(r)) 
u  =  G  1  {u  jCt )  +  u  2(x  )  +  v  ) 
v  =  6  T(z  . v  .  8  ,  €  .  r  ) 
r  =  T(x) 

£(t)  =  T)(.X  )  —  C  (t) 


m 


i 


w. 
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w! 
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c  =  e2  y(r) 

8  =  e2  ct(t) 
d x 

where  x  =  - and  y(r)  and  cr(r)  are  smooth  functions  that  give  rise  to  a  bounded  reference 

d  r 

input  c(t).  and  a  small  disturbance,  i.  e.. 

Assumption  A4.6.1: 

The  reference  input  c  (r)  €  D  ,  the  disturbance  8(r)  £  E  . 

D  -  {  c  €  R  :  |  c  (t)  |  <5  .  |  c  (r)  j  =  O  (e~)  ,  for  cf/  r  €  [  r0  ,  oo  )} 

E  =  {  8  €  R  :  |  8(t)  |  <8  ,  |  8(r)  |  =  0  (e-)  ,  for  all  r  €  [  r0  ,  oo  )} 

where  B  is  a  positive  number  ,  8  is  a  small  number  as  presumed  in  Assumption  A4.5.1,  and 

r0  is  the  initial  time. 

Theorem  4.6.1 

For  the  nonlinear  plant  x  =  f  (x)  +  g(x)u  with  nonlinear  output  >’  =  r)(x  )  ,  a  slowly 
varying  unknown  reference  signal  c  (r)  and  a  disturbance  8(r)  both  satisfying  Assumption 

A4.6.1.  the  control  u  =G  1(u1  +  u2  +  v)  will  result  in  tracking  error  E  (r)  -*  O  (e)  as 

t  -*  oo  Uj  ,u2  ,andv  are  as  in  Corollary  4.4.1.  6  6(0,8]  is  the  integral  gain  and 
0  <  €  «  1  . 

Proof: 

In  slow  time  scale  t  =  €T 


e —  =  Az  +  B(v  +  8G  ) 
dt 

dv 

—  =  r(z  ,  v  ,8,6,1  ) 

dt 

dS 

- =  e  cr(r ) 

dt 


(4.6.1) 


(4. 6. 2. a) 


(4.6. 2. b) 


where  &(c  )  =  ct(t/ e)  ,  etc. 


By  Lemma  4.4.1,  (4.6.1)-(4.6.2)  has  a  globally  attractive  integral  manifold 


z  —  h  (v  ,  8  ,  €  ,  t  ) 


(4.6.3) 


..  V.’*s*w 


££ 
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and  can  be  solved  from  the  PDE 


fth  ~  _  Q/z  _  Qh 

€  ( —  r(/z  ,  v  .  S  ,  €  ,  t  )  +  €  — <T  +  — )  =  Ah  +  B  (v  +  8G  )  . 

Sv  3$  & 


Denoting 


we  have 


h  =  /i°  +  6/i1  +  62/!2  4...  , 


e°:  Ah0  +  B  (C  +  BG  (h0))  =  0  .  fz 0  = /z°(v  .  8) 


,  q/z  -  o  ,  a 

e:  - r(/j  .v  .  S.O.rj^/z1  +  —  B  SG  (/z )  ,£  =  0 

0v  9e 


.  h  1  =  h  l{v  ,  8  ,  f  )  , 


Hence. 

h  (v  .  8  .  €  ,  £ )  =  h  °(v  .  8)  +  eh  (v  .  8  .  e  .  t ) 

Thus,  when  the  trajectory  of  (4.6.l)-(4.6.2)  is  on  the  manifold  (4.6.3),  the  plant-output 


becomes 


w  (z  )  =  w  (h  (v  ,  5  ,  e  .  t  )) 


Differentiating  the  above  expression  with  respect  to  t  gives 

dw  Qw  Mi  dv  Qh  _  Qh 

-  =  - ( - +  €  —  <r(r )  +  e —  ) 

dt  Qr  0v  dt  98  Qt 

. ,  0 

Aw  dh  1  dv  —1  Aw  dv 

=  ( - )  —  +e  >Kv  .  8  ,  t  .  e)  =  ( — )( - )  —  +  e  ¥(v  .  S  ,  t  .  e) 

3-i  0v  dt  ax  fei  dt 

By  adopting  the  integral  control 


dv  $w  Qw 

—  =  al  -  E  =  al  -  (w  —  c  )  . 

dt  Qz !  3*  1 

we  have  from  (4.6.4) 


-  =  — (w  —  c  )  +  ety  .  ( 

dt 

Now  by  using  a  new  relative  slow  time  scale  s  =  &  .  we  have  the  following  subsystem: 


(4.6.4) 


(4.6.5) 


(4.6.6) 


R  ^ 
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t 


€ =  — (w  -  c  )  +  eV 

ds 


(4.6.7.a) 


=  yU ) 


(4.6. 7.b) 


where  y(r  )  =  y(r/€  )  .  It  is  easy  to  see  that  (4.6.7)  has  the  following  integral  manifold: 


w  =  W  (c  ,  s  ,  e) 


(4.6.8) 


where  W  satisfies  the  following  PDE 


aw  QW 

e( - y  + - )  =  -(W  -  c  )  +  e¥ 

dc  ds 


Solving 


W  (c  .  s  .  e)  =  c  —  e(y(r  )  +  ^0)  +  ■  •  ■  (4.6.9) 

Overall,  the  trajectory  will  asymptotically  converge  to  the  integral  manifold  (4.6.3)  and  then 


later  to  the  integral  manifold  (4.6.9)  within  the  manifold  (4.6.3). 


Note  when  the  subsystem  (4.6.7)  is  on  the  manifold  (4.6.8)  we  have  from  (4.6.9)  the  follow- 


w  —  c  =  O  (e)  .  (4.6.10) 

By  (4.6.10)  and  (4.6.6)  we  conclude  that  asymptotic  tracking  and  disturbance  rejection  to 


O(e)  neighborhood  of  origin  can  be  achieved  when  an  integral  control  of  the  form  (4.6.4)  is 


4.7.  Example  and  Simulations 


Consider  the  nonlinear  system  on  R' 


x .  +  -  +  x,+e  —  1 

ci  2  0 

2  +  i  “ 

■2  x,  1 


(4.7.1) 


=  /(x)  +  g(x)u 
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where  u  represents  control  and  x  =  -  is  the  time  derivative  of  a  j  etc.  \ote  that  (4.7.1) 

d  t 


has  an  unstable  equilibrium  at  the  origin  because 


df_  _  [1  2 

3a  I  (0.0)  0  0 


Compute  the  Lie  bracket. 


f  -g  ~ 


-(1  +*  0 
0 


it  is  easy  to  show  that  {  g  .  |  /  ,  g  j  )  is  linearly  independent  on  R‘ 
Integrating  along  {  g  .  /  .  g  }  gives 


*i  -2  Cl 

x ,  8 


(4.7.2) 


The  noncharacteristic  matrix  of  (4.7.2)  is 


-2  0 
0  1 


which  satisfies  the  ratio  condition  with  p  =  1/2  [28], 

Thus,  we  are  assured  that  (4.7.1)  is  external  feedback  linearizable  on  R‘ 
For  our  new  local  coordinates  we  choose 


-i  0(a) 

~x  i  '2 

"y 

< 

c2  Lf  n(A ) 

2 

-1  *1 

- (a  ,  +  -  +  a2  +  e  -  1) 

2  2 

*  i 

differentiated  with  respect  to  r  gives 

dz,  _ 

'  ,1 

~  -  2 

dz  2 

d  T 

= 

F(x)  +  G(x)« 

"'C 

d  T 

where 


—  J  X  j  ^  ^ 

F  (a  )  =  - (  ( 1  +  a  j)(a  ,  +  -  +  a  2  +  e  2  —  O  +  A^O+e  2)  ) 

2  2 


y 


2 


86 


1 


G  (x  )  =  — — (1  +  e  )  . 
2 

It  is  easv  to  see  that  G  X(x  )  exists  on  R2  . 


Following  a  discussion  in  Section  4.4  we  now  apply  a  nonlinear  feedback  of  the  form 


u  =  G  1(u  j  +  u2  +  v  ) 
where  u  t  is  used  to  cancel  the  nonlinearity  and  is  given  by 


u  !  =  —F(x  )  . 

The  linearized  system  is  stabilized  by  u,.  A  choice  of  u2  is 


u  =  —6:  ,  —  5: 


=  3x  j  +  2.5(x  j  +  -  +  e  2  +  x  2  ~  1 ) 


The  equivalent  stable  linear  system  is  then  given  by 


1 

d  r 

o  ,| 

-.1 

+ 

0 

dz2 

lO 

1 

t 

~  2 

l 

d  t 


Suppose  our  plant  output  is 


y  =  7}(x  )  -  e  1  +  x , 

—2z 

=  w  (z  )  =  e 
Let  the  unknown  set-point  be  denoted  by  c. 

The  tracking  error  in  z  coordinates  is 


~  2-  i 


-2z  , 


E(t )  —  —2:  !+e  '  —  c  =  w  (z  )  —  c. 

Equation  (4.7.3)  in  slow  time  scale  t  =  er  is 


i 

€ - 

df 

— 

0  1 

z  t 

+ 

0 

dr  2 

-6  -5 

22 

1 

e - 

dt 


which  together  with  nonlinear  integral  control 


(4.7.3) 


(4.7.4) 


$ 


2 

j 


< 


m 


&&  urs  bv-..  KO  ill  7.V.V/  M 
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S 

I 


—  =  r(£(-),v  .e) 
dr 

have  an  integral  manifold  z  —  h  (v  ,  e)  =  h°{v  )  +  eh  1(v  )  +  •  •  and  h  satisfies 

Ah 

e  —  v  =  Ah  (v  ,  e)  +  Bv  . 

ev 

The  M 0  manifold  is  obtained  by  solving 

0  1  o  01 

°*  -6-5  *  +  .l” 


,  »10  1/6 
h  <V,  =  -  -6-5  1  V  =  0  ” 


Aw  Ah  -22,  1/6  1  -22, 

—  —  =  -2(1  +e  ')  0  *--(l+e  ') 

32  Av  0  3 


132  3v  1 

When  the  nonlinear  integral  control  is  governed  by 

-i 


£ 

dv 

dw 

; 

d  T 

3- 

av 

we  have 


-eEU) 


3e£(t ) 

,  ,  *i 


—  (l  +  e  ~2" ')  1+e 

3 


f  . 

V  ^ 

ij 

v  .  * 


!  N 


i 

Lj 

si  s- 


dw  0w  Ah  dv 

—  =  —  - - =  -e(l  +  0(e))E  =-€(1  +  0  (e))  (w  -c)  . 

dr  32  3v  dr 

Consequently.  £  (r )  -*  0  asymptotically.  A  simulation  with  set-point  c  =  1  +  e1  ,  e  =  0.05 
and  various  initial  conditions  is  shown  in  Figure  4-3.  It  is  worth  remarking  that  in  a  constant 
set-point  problem  perfect  asymptotic  tracking  as  achieved  even  though  we  design  our  integral 
controller  based  on  O  (e)  approximated  manifold.  Regardless  of  the  initial  conditions,  all  tra¬ 
jectories  converge  to  the  manifold  and  then  flow  along  it  towards  the  equilibrium  point.  As 
can  be  seen  from  Figure  4-3,  the  2j  -  coordinate  of  the  equilibrium  point  is  -1/2.  which 
corresponds  to  x  t  =  1.  As  expected,  all  the  trajectories  asymptotically  converge  to  the  equili¬ 
brium  point  where  we  achieve  perfect  tracking.  Figure  4-4  shows  the  tracking  error  Eft) 
asymptotically  goes  to  zero.  When  an  additional  unknown  bounded  disturbance  is  also  added. 
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the  simulation  in  Figure  4-5  shows  that  asymptotic  tracking  is  still  achieved.  As  shown  in 
Figure  4-6,  with  a  new  value  of  6  =  0.018  ,  O(e)  asymptotic  tracking  is  still  achieved  when 
both  reference  input  and  disturbance  are  slowly  varying.  8  =  3.718  —  0.0972  sin  (r/300)  and 
c  =  0.5  -  1.62  X  10“2  co.r  (t/50)  . 


4.8.  Proof  of  Lemma  4.4.1 


Proof: 

In  order  that  h  (v  .  t  ,  e)  be  an  integral  manifold  for  the  system,  it  is  necessary  that  it 
satisfies  the  following  PDE: 

,Qh  ,  Qh 

e( — T{h(v  ,t  ,  e)  ,  v  ,  t  ,  e)  + — )  =  Ah  (v  ,  t  ,  e)  +  Bv  .  (4. 8.1. a) 

3V  & 

Let 

h(v  .  t  .  e)  =  h  °(v  ,  c )  +  eh.  (v>  ,  t  .  e)  .  (4.8.  l  .b) 

Equating  the  coefficients  of  powers  of  e°  on  both  sides  of  (4. 8.1. a). 


€°:  Ah  °(v  ,  t)  +  Bv  =0 


(4.8.2) 


or 


h  °(v  ,  t  )  =  h  °(v  ,  t  )  =  h  °(v  )  =  —A  1  Bv 


with  (4.8.1  .b) 


—  HMv  ,  t  ,  e)  ,  v  ,t  .  e)  H - -Ah(v  ,c,e)  (4.8.3) 

3V  df 

Since  A  is  Hurwitz.  there  exists  a  positive  definite  symmetric  matrix  P  such  that 

A  f  P  +  PA  <  -C 

where  C  >  0  . 

To  show  that  the  integral  manifold  has  a  global  region  of  attraction  we  shall  prove  that  the 
deviation  from  the  manifold  goes  to  zero  asymptotically  for  all  initial  condition  (f  0  ,  f  0)  with. 


:  =2  —  h  (v  .  i  .  e) 

Taking  derivatives  with  respect  to  t  on  both  sides  of  the  above  expression  gives 


d:  d:  Qh  dv  Qh 

e —  =  € - e  ( - +  — ) 

dt  dt  0v  dt  Qt 


=  Az  +  Bv  -  €  ( —  Hr  ,  v  ,  t  .€))+—) 

dv  dt 


SB 


%8l 


$ 

$ 

*‘V 


$ 


& 


WWW 


a/i  .  #> 

=  A  (z  +  /j  (v  .  r  .  e))  +  5v  —  e  ( —  r(z  +  h  (v  .  i  .  e)  .  v  .  r  .  e)  +  — ) 

8'*  8» 


-  5  -  fa 

=  A  (z  +h  (v  ))  +  Bv  +e(Ah - f(z  +h(v  ,  r  .  e)  .  v  .  t  ,  e) - ). 


Bv  (4.8.2)  and  (4.8.3) 


dz  Mi 

e —  =  Az  +  e —  (r(/i  (v  .  t  .  e)  .  v  .  r  ,  e)  —  F(z  +  /i  (v  .  r  .  e)  .  v  .  r  .  e))  . 
dr  0v 

We  now  use  the  Lyapunov  function  v  (z )  =  z  Pz  >  0  to  show  that  the  above  equation  has 


an  asymptotically  stable  equilibrium  at  the  origin. 


r  „  r  Ml 

ev  <  — z  Cz  +  2ez  P —  (m  (v  .  r  ,  e)  .  v  .  c  .  e)  —  T(z  +  h  (v  ,  r  .  e)  .  v  .  r  ,  e)) 


Since  F  6  C"  .  F  is  Lipschitzian  .  i.  e.. 


|F(/t  (v  .  c  .  e)  .  v  ,  c  ,  e)  —  T(z  +  h  (v  ,  t  ,  e)  ,  v  ,  t  .  e)|  <  L\z  \ 
where  L  is  a  positive  constant. 


Also,  since 


dh  dh  -X  3* 

—  =  - —  +  e  — —  =  —A  B  +e  — 


3V  av  3V 


we  have 


<  2\\A~lB  ||  . 


Pick  k  j  .  k  2  >  0  such  that  zT  Cz  ^  k  x\z  |2  and  zT  Pz  ^  k2  \  z  |“  for  all  z  6  Pn  .  With 


e  6  (0  .  e  ]  where  €  =  k  1/5k2L  |J  A  lB  ||  we  have  v  <  0  uniformly  in  z  and  hence  the 


uniform  asymptotic  stability  of  the  system  governing  the  deviation  from  the  integral  mani- 


,vW.v 
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5.  OPTIMAL  CONTROL  SYSTEMS 


5.1.  Introduction 

We  have  shown  in  Section  2.2  how  a  linear  system  with  slow  and  fast  modes 


X 

A  n  A  12 

X 

B1 

ez 

~ 

A  2i  ^  22 

z 

+ 

b2 

u  ,  A  2->  nonsingular 

is  equivalent  to  a  pure  slow  problem  with  a  lower  state  dimension 

x  =  (a  n  +  a  12  L  )  x 
zU)  ~  L  x  (t  ) 

provided  that  the  initial  conditions  are  on  the  integral  manifold  z  -  Lx  ,  i.  e.. 
c  ( r , , )  =  Lx  (r0)  and  L  satisfies  (2.2.3). 

This  type  of  model  reduction  is  made  possible  when  the  initial  conditions  are  restricted  to 
the  manifold.  We  shal’  see  in  Section  5.2  that  there  exists  a  reduced  order  optimal  linear- 
quadratic  system  which  is  equivalent  to  a  higher  order  regulation  problem  with  slow  and  fast 
dynamics.  When  the  existence  of  an  integral  manifold  is  assured  in  the  optimal  system,  we 
then  pursue  the  problem  where  the  initial  conditions  do  not  start  on  the  manifold.  It  will  be 
shown  that  the  optimal  system  can  be  decomposed  into  two  subsystems.  One  of  these  is  a 
decoupled  optimal  subsystem  that  governs  the  convergence  of  the  trajectory  to  the  slow  mani¬ 
fold.  For  the  system  with  slow(  O(l)  )  and  fast(  CKl/e)  )  modes,  the  cost  required  to  bring 
the  trajectory  to  the  manifold  is  of  O  (e)  in  the  overall  optimal  cost.  A  complete  decomposi¬ 
tion  of  the  optimal  system  into  decoupled  pure  slow  and  pure  fast  subsystems  characterizes 
the  slow-fast  behavior  of  the  optimal  trajectory.  For  fixed  end-point  tracking  problems  we 
propose  an  approximate  scheme  that  renders  similar  analysis  applicable. 

5.2.  Linear-quadratic  Optimal  Problems  as  Restricted  to  the  Integral  Manifold 

We  study  the  regulation  problem  of  the  following  system: 


92 


X 

A  u 

-4  12  | 

X 

B 1 

ez 

— 

-4  21 

.4  22  1 

z 

+ 

B , 

u  ,  A  22  nonsingular  .  r  £  Rn  ,  -  €Rm  ,u£Rr  (5.2.1) 


A  /• 

J  —  —  /  x  Qx  4-  z  Sz  +  u  Ru  dt  (5.2.2) 

2 

*  n 


0 

X 

X 

X 

= 

0 

. 

~ 

;  =0 

z 

z  ■ 

/  ree 

X) 

where  AtJ's  and  Bt‘s  are  understood  to  be  of  appropriate  dimensions.  Matrix  R  is  positive 
definite  and  Q  and  S  are  both  positive  definite  or  positive  semi-definite  matrices.  The  constant 
e  is  a  small  positive  number.  Vector  V  stands  for  the  transpose  of  the  vector  V  . 

We  are  seeking  an  optimal  control,  u  .  that  minimizes  the  scalar  cost  functional.  J. 
Consider  the  reduced  problem,  i.  e.,  €  =  0  .  l>om  (5.2.1) 

I  = -A  22  (A  2lx  +  B2u)  (5.2.3) 

Substituting  this  into  (5.2.l)-(5.2.2)  we  have  the  following  reduced  linear-quadratic  problem: 

x  —  A  0x  +  B0u 

CO 

Min  Min  1  r  _■  _  ■ 

J  o  ~  _  ~  J  x  Q0x  +  2  u  C  0  x  +  u  R  0u  dt 

u  u  2  n 


jr(0)=Ar°  ,  ;t(oo)  free 


where 


A0  A  11  A  12A  22  A  2i 

B  0  =  B  y  —  A  12  A  22  B  2 
Qo  ~  Q  +(A~1A2l)S(A-1A2l) 

R0=  R  +  (A  22  &  2)S  U  22B2> 

Co  =  22  B  2)S  (A  22  A  21) 

It  is  obvious  that  the  reduced  optimal  problem  is  easier  to  solve,  due  to  its  lower  state  dimen¬ 
sion.  Note  that  a  coupling  term  u  C0x  appears  in  the  reduced  cost  functional  .  To  facili¬ 
tate  our  discussion,  we  adopt  the  following  assumption: 
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Assumption  5.2.1 


The  reduced  problem  has  a  unique  optimal  solution. 


Derive  the  optimality  condition  for  the  reduced  system  by  Hamiltonian  formulation[3l] 


H  =  —  (x  Q  0x  +2  uCqX  +  uR0u)  +  \  (A  0x  +  B0u) 
where  X  is  the  costate  variable  and  satisfies  the  following  state  equation: 


X  = - =  —  Q0x  —  A  0  K  —  Cnu 

d x 

In  order  that  U  be  an  optimal  control  it  is  necessary  that 


=  R0u  +B0\+C0x=  0  . 


Thus, 


u  =  ~R q1  (B 0\  +  C 0x  )  . 

Thus,  the  optimality  conditions  for  the  reduced  system  are 

x  A0-B0R0  C0  ~B nR 0  B 0  jf 

X  ~Qo  ^  Co  — 1 ~^o^o  C0)  X 

x(0)  =  ;t0  .  X(oo)  =  0  . 


(5.2.4) 


When  €  is  small  but  nonzero  we  can  use  the  manifold  idea  to  obtain  an  equivalent  system. 
Since  we  have  a  system  (5.2.1)  subject  to  the  constraint  of  minimizing  (5.2.2),  it  is  not  easy  to 
see  the  existence  of  the  integral  manifold.  Instead  we  investigate  the  closed-loop  system  when 
the  optimality  condition  is  obtained  from  the  associate  Hamiltonian  equation. 

1  X. 

H  -  —  (x  Qx  +  z  Sz  +  u  Ru  )  +  X  v  (.4  nx  +  A  l2z  +  B  xu  )  +  —  ( A  ,jX  +  A  2,z  +  B -,u  ) 

2  € 

=  —  (x  Qx  +  z  Sz  +  u  Ru  )  +  X,  (A  ux  +  A  vz  +  B  )  +  X,  (A  21x  +  .4  22z  +  B  2u  ) 

2  ‘ 

k 

where  X(  and  X.  are  the  associate  costate  variables.  The  variable  X,  =  —  is  the  scaled 

e 

costate  variable.  In  order  that  u  be  a  minimizing  control  to  (5.2.1)-(5.2.2),  it  is  necessary 


IA 


that. 


1.  e.. 


94 

a2#  . 

=  0  and  -  >  0  . 

a* 

a*2 

Ru 

+  i?  j  X,  +  B  2  X .  =  0 

(5.2.5) 

and 


R  >  0  .  (5. 2.6. a) 

Equation  (5. 2. 6. a)  is  trivially  satisfied  since  we  assume  that  R  is  a  positive  definite  matrix. 

(5.2.5)  gives 


u  =-R  1  (B ,  X,  +  £2X2)  (5.2. 6. b) 

The  standard  calculus  of  variation  approach  to  optimal  problems[3l]  yields  the  following 


costate  equations: 


SH 


K  -  Qx  A  u  Xx  A  21  X. 

d * 


3# 


€  —  —  Sz  A  12  \x  A  22  Xz 

d* 


We  then  come  to  the  optimality  conditions: 


X 

a  ii 

-B  ji?  l*j 

24  12 

-5)7? 

K 

— Q 

-^n 

0 

-24 

€Z 

^21 

—b2r~1b  j 

^  22 

-B2£ 

0 

l2 

-s 

-24 

—  1  n 


21 

-1  r* 


X, 


(5.2.7) 


22 


0 

X 

X 

X 

/Vv 

2 

II 

o 

II 

0 

12 

• 

=  0 


Since  this  is  an  infinite-time  linear-quadratic  regulation  problem,  we  have  the  equivalent  end 
conditions 


X 

*0 

X 

z 

'  f  = 

ro 

* 

z 

=  0 


In  view  of  the  cost  functional  to  be  minimized,  a  good  controller  should  drive  the  states  to  zero 


£ 
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V 

V$ 
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as  time  tends  to  infinity.  We  now  show  that  the  reduced  optimality  condition  obtained  by  set¬ 
ting  6  =  0  in  (  5.2.7)  is  identical  to  the  optimality  conditions  of  the  reduced  optimal  problem 
(5.2.1M5  2.2). 


£ 

Rewriting  the  optimality  conditions  (  5.2.7)  by  keeping  u  and  setting  e  = 

0  gives 

% 

X  =  AllX  +  Au2°  +  B1U 

(5.2.8) 

no 

0  =  A  21.r  +  A  22:  °  +  B  2u 

(5.2.9) 

K  =  ~QX  ~  A  n  K  ~  A  21 C 

(5.2.10) 

5 

0  =  —Sz°  —  .4  l2  \x  -  A 22  X2° 

(5.2.11) 

»/ 

where  u  is  given  by 

*\L7 

—  =Ru'  +  B1\x  +  B2\?  =  0 

> 

Eliminating  \°  by  (5.2.11),  we  have  the  reduced  optimality  conditions 

S 

TA 

x  =/4ni  +  A  l2z°  +  B  jU 

(5.2.12) 

1 

Ax  *  -Qx  -An\x  +  A  nA  22-1  (Sz  °  +  A  u  \x  ) 

(5.2.13) 

v 

x  (0)  =  x°  .  x  (oo)  =  0 

,%* 

c 

where  u  satisfies 

Ru  +  B  j  \v  -  £2,4  22  1  (Sr°  +  4  12  X*  )  =  0 

(5.2.14) 

V 

and  z"  satisfies 

v-. 

0  =  A2i*  +  A  22z°  +  B  2u 

(5.2.15) 

V. 

Equations  (5.2.12)-(5.2.15)  are  the  reduced  optimality  conditions. 

V, 

"> 

We  now  study  the  reduced  system  and  find  its  optimality  conditions.  When  we  set  6  =  0 

y 

y, 

in  (5.2.1  )-(5.2.2).  the  optimal  infinite-time  regulator  problem  becomes 

v 

x  =  A  ux  +  A  12r  +  B  ju 

(5.2. 16. a) 

jVJ 

V 

0  =  /l21x  +  A  22z  +  B2u 

(5.2. 16. b) 

The  associate  Hamiltonian  equation  is 

‘S.  1 

H  =  —  (x  Qx  +  z  Sz  +  u  Ru  )  +  \x  (A  nx  +  .4  uz  +  B  ) 

(5.2. 16. c) 

where  A(  is  the  associate  costate  variable  and  r  (x  .  u  )  satisfies  (5.2. 16. b). 

Necessary  conditions  for  optimality  are 

QH  0-? 

-  —  Ru  +  B  j  \x  +  —  (Sr  +  A  12  Ax  )  =  0 

du  du 

QH  Qz  . 

A,  = - -  =  —Qx  —  A  n  Xx - (Sr  +  .4  12  Aa  ) 

a*  dx 

From  (5.2. 16. b) 

—  B  0^4  ^2  and  n 

3^  ~  q* 

So  the  reduced  optimality  condition  for  the  reduced  optimal  problem  is 

x  =Anx  +  .4  12r  +5^  (5.2.17) 

Ax  =  -Qx  -  A  n  Ax  +  A  21i4  22_1  (Sr  +  A  12  Ax  )  (5.2.18) 

-v  (0)  =  x°  ,  x  (oo)  =  0 

u  satisfies 

Ru  +  5 1  Ax  -52/422-1(Sr  +  A  12  Ax  )  =  0  (5.2.19) 

and  r  satisfies 

0  =  A  2Ix  +  A  22z  +  B2u  (5.2.20) 

Comparing  (5.2.17)-(5.2.20)  with  (5.2.12)-(5.2.15)  we  come  to  the  following  Lemma: 

Lemma  5.2.1 

The  reduced  problem  (5.2.16)  is  formally  correct. 

Now.  we  recapitulate  what  we  have  done.  We  derived  the  necessary  optimality  condi¬ 
tions  for  the  full  optimal  system  (5.2.1 )— (5 .2.2)  and  then  obtained  the  reduced  optimality  con¬ 
ditions  (5.2.8)-(5.2.11)  by  setting  6  =  0  in  (5.2.7).  They  were  compared  with  the  optimality 
conditions  of  the  reduced  optimal  problem  (5.2.16)  and  were  found  to  be  the  same.  In  other 
words,  the  reduced  optimality  conditions  (5.2.8)-(5.2.1 1)  correspond  to  the  optimal  problem 
given  by  (5.2.16).  Assumption  5.2.1  implies  that  a  unique  solution  to  (5.2.19)  exists.  The 
nonsingularity  assumption  on  A  22  made  the  above  discussion  possible. 
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Observe  that  the  optimality  conditions  (5.2.7)  can  be  viewed  as  an  initial  value  problem 


where  K  satisfies  an  algebraic  Riccati  equation  associated  with  the  entries  of  the  system  matrix 
in  (5.2.7)  [3 2 ].  Thus,  we  can  rewrite  (5.2.7)  as 


X 

r 

K 

Fn  F j2 

ez 

■^21  F  22 

'  % 

e\2 

where  F 6  R“n  *2"  . 

Fl2 

€  R  x 

where  F  Xl  6  R  .  F  x2  €  R  .  F  21  €  R  ,  and  F 22  €  R  correspond  to 

appropriate  entries  of  the  system  matrix  in  (5.2.7).  It  is  known  that  T  has  (2n  +  2m  )  eigen¬ 
values  of  which  2n  are  slow  (  0(1)  )  and  2m  are  fast  (0(1/6))  .  From[32]  it  was  pointed  out 
that  half  of  the  eigenvalues  of  T  are  symmetric  to  the  other  half  with  respect  to  the  origin. 
Because  of  the  clear  slow-fast  separation  due  to  the  smallness  of  6  .  we  can  conclude  that  T  has 
n  slow  eigenvalues  which  are  symmetric  to  the  other  n  slow  eigenvalues  and  the  same  for  its 
2m  fast  eigenvalues.  With  these  facts  we  are  ready  to  prove  the  main  theorem  with  the  fol¬ 
lowing  assumption: 

Assumption  5.2.2 

F 22  is  nonsingular. 

Theorem  5.2.1 

There  exists  a  lower  order  optimal  problem 


x  t  —  A  (  x  f  +  Bt  u  E  xt  €  Rn  ,uf€R’ 


(5.2.21  a) 


! 
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m 

M 


_ fl  A  r 

J  =  —  /  x.Qtx.  +  2u.Ccx.  +  u.R'U.dt 


(5.2.2  l.b) 


xe(0)  =  .rs°  =x°  ,  xf(co)  free 

that  is  equivalent  to  the  optimal  regulator  problem  (5.2.l)-(5.2.2)  for  some  initial  conditions 


This  means  that  the  optimal  controls  in  two  optimal  systems  are  the  same: 

u  it )  =  ue  (r  )  .r^O 

Furthermore,  the  state  trajectories  along  this  optimal  control  are  also  the  same: 


x  it )  =  x  ( it )  .  t  ^  0 


Proof: 


The  optimality  conditions  of  the  full-order  optimal  problem  (5.2.1 )-( 5.2.2)  is  in  the 
standard  form  of  a  singularly  perturbed  linear  system 


Djj 


ft 
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X 

X 

X 

X,° 

z 

• 

- 

— 

0 

X. 

x" 

u  =  -R  iBlkx  +  B2\. )  . 

By  Corollary  2.2.1.  there  exists  an  integral  manifold  (5.2.23)  in  (5.2.22). 


z 

X. 


=  L 


where  L  €  R~m  *  satisfies 


Furthermore. 


F 2i  +  F 22L  -  eL  (F n  +  F X2L  ) 


(5.2.22) 


(5.2.23) 


Lie)  =  —F22F2l  +  0(e)  . 

Thus.  (5.2.22)  is  equivalent  to  the  following  lower  order  system  (5.2.24)-(5.2.25),  provided 


& 
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aj 


3 
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i.  e..  the  initial  conditions  are  on  the  integral  manifold  (5.2.23). 


X 

X 

X 

X 

0 

X 

K 

=  (F„  +  F12I  («» 

K 

=  <t>{ 

K 

■ 

1  =  0 

X,0 

:it) 

x(t  ) 

B  11 

B  12 

X  (t  ) 

A.  (t  ) 

=  L 

At  (r  ) 

— 

B  21 

L  22 

KU ) 

and  the  optimal  control  u  on  the  manifold  becomes 


t  >  0 


(5.2.24) 


(5.2.25) 


u  =  -R  l(B2L2lx  +(B[  +  B2L22)\x))  (5.2.26) 

Note  the  dependence  of  L  on  the  parameter  e  .  At  e  -  0  we  have  the  reduced  optimality  condi¬ 
tions  from  (5.2.22).  and  by  Lemma  5.2.1  this  is  identical  to  the  optimality  conditions  (5.2.4) 


of  the  reduced  system.  Thus,  we  have 


(Fu  4-  F i2L0)  -  <&0  - 

Note  that  ($0)22  =  ~  u 
For  6^0 


A  o  BoRq  C o 
Q  +  C  qR  o  C  ^  -{A  0~  B0R0  C0) 


& o 


(5.2.27) 


3>e  =  <D0  +  e  <*>,(€) 

To  show  that  (<t>{)22  =  —  (<t>{)  n  .  We  shall  prove  it  by  contradiction.  Suppose 
(<t>e)22  5^  —  C<t»€)  u  .  We  understand  that  <l>{  has  2n  eigenvalues  and  half  of  these  are  sym¬ 
metric  to  the  other  half  with  respect  to  the  origin.  So  with  some  elementary  iua  operations 
applied  to  4>,  .  we  can  obtain  a  matrix  4>{  with  (<J>f)22  =  ~  ($*)  n  • 

<J>f  =  E  <J>e  =  E  <t>0  +  e  E  $i(e)  ,  E  &  I 

However,  since  we  already  have  ($0)22  =  “  ($0)  11  ■  premultiplying  <T>0  by  an  elementary 
matrix  E  other  than  the  identity  matrix  would  thus  deprive  <t>0  of  this  property.  Therefore. 
(4>e)32  s*  —  (<3>£)n  .  contradicting  our  assertion.  So  we  must  have  (<l>f)22  =  ^  >s  easy 

to  see  that  the  optimality  conditions  of  (5.2.21)  are  the  following: 


a 


a-  I  IA.-B.X'C.  —BtR.  lB.  I  a- 


-Qt  +  CtRt  lC(  -U  (~BeR(  ‘C€)l  A, 


0 

X 

( 

i  =0 

A,° 

( 

ue  =  ~R(  1  (B  (\x '  +  C  (  X  . 

The  question  of  the  existence  of  an  optimal  problem  with  optimality  conditions  and  optimal 
control  identical  to  (5.2.24)  and  (5.2.26).  respectively,  is  equivalent  to  the  issue  of  the  solva¬ 
bility  of  (A  t  .  B  (  .  C  e  .  Q  {  .  Rf)  in 


A'-B'R'  c( 


-BtRt  B( 


.  =  <t> 


\-Q(  +  C€R(  1  C£  -(At-BtRt  1  C()  I 
-*£_1  {B(KX  +  Cex£)  =  -R~1CB2L21x  +(Bl  +B2L22)\x) 


Since  (<t>£)-,-,  =  —  (^>c)  lx  ,  we  have  a  well-posed  problem  of  five  equations  with  five  unknowns: 
(.4  B ,  .  C  .  Q  ,  R  £)  viz. 


A(-BeR:1  C€  =  (*e)n 

(5.2.28) 

-Q'  +  C'R'-1  CE  =  (<De)21 

(5.2.29) 

-b,r;1  Bt  =  (*,)I2 

(5.2.30) 

Ct  =  -R~lB2L2l 

(5.2.31) 

f_1  B(  =-R~l(B  l  +  B 2L  22) 

(5.2.32) 

We  have  shown  that  the  solution  (.4 ,,  . B0 .C- .Q o  •  exists  for  the  above  equations  at 
e  =  0  .  By  the  implicit  function  Theorem,  for  €  small  enough,  there  exists  a  unique  solution  of 
the  form 

B  =  Bn  +  0(e) 


I 
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ES 


R,  =  R„  +  0(e) 


A(  =  A0  +  Ote) 


C€  —  C0  +  O(e) 


Q(  =  Qc  +  0(e) 


Thus,  this  completes  our  proof. 


We  have  shown  that  a  lower  order  optimal  system  possesses  the  same  optimality  condi¬ 


tions  and  optimal  control  as  that  of  the  full-order  optimal  problem  with  its  initial  conditions 


restricted  to  a  manifold.  The  (.4{  .  B  t  ,  C  £  .  Q  (  ,  R  {)  characterizing  the  lower  order  system  is 


of  O  (e)  perturbation  from. the  (.A  0  ,  B0  ,  C0  .  Q0  .  R 0)  of  the  reduced  optimal  problem.  The 


unique  existence  of  (A  e  .  B (  .  C  (  .  Q  e  .  R ()  is  assured  by  the  existence  of 


(A  0  .  B  0  .  C  0  .  Q  0  ,  R ,,)  and  the  smallness  of  the  perturbation  parameter  e  .  It  is  worth  point¬ 


ing  out  that  in  general  a  set  of  optimality  conditions  does  not  correspond  to  a  unique  optimal 


problem.  As  an  illustration,  consider  the  optimality  conditions 


f.x  1  \A  -  BR  lC  -BR  lB 


I -Q  +  CR  lC  -(A  -  BR  lC  )  I  [\  . 


x(0)  =  x  .  k(T)  =  0  ,  R  >  0 


It  is  easy  to  check  that  both  of  the  following  optimal  problems  come  up  with  the  same 


optimality  conditions  as  above: 


x  =  A  x  +  B  u 


Min  .  Min  1  /•  ■  „  ■ 

/=  —  xQx+2uCx+uRudt 

u  u  2 


x  (0)  =  x  .  x(D  free 


x  =  (A  —  BR  'C  )  x  +  B  u 
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Min  .  Min  1  r  -i 

J  =  —  x  (Q  -CR  C  )  x  +  u  R  u  dt 

U  U  “>  J 

A  0 

x  (0)  =  x  °  .  x  (T  )  / ree  . 

However,  the  optimal  control  in  these  two  optimal  problems  is  different. 

53.  Decomposition  of  Optimal  Linear  Systems  with  Quadratic  Criteria 

As  discussed  in  the  previous  Section,  a  full-order  optimal  system  is  equivalent  to  a  lower 
order  one,  provided  it  starts  with  its  initial  conditions  on  the  integral  manifold.  When  the  ini¬ 
tial  conditions  are  not  on  the  manifold,  there  is  a  deviation  from  the  manifold.  It.  will  be 
shown  in  this  Section  that  the  optimal  trajectory  will  converge  to  this  slow  manifold.  This 
mechanism  is  analyzed  by  decoupling  the  optimality  conditions  into  two.  One  of  these 
corresponds  to  the  optimal  system  as  restricted  to  the  manifold.  The  other  one  governs  the 
behavior  of  the  deviation  from  the  manifold. 

We  start  by  looking  at  the  optimality  conditions  (5.2.7)  of  the  linear-quadratic  regula¬ 
tion  problem  (5.2.1)-(5.2.2): 


A  11 

-B^R  :B: 

A  12 

-B  xR~l 
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-An 
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A  21 

A  21 

~b2r~xb1 
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-B2R~\ 
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—A  12 
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A  22 
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F  n  F 12  \ 
F  21  F  22  - 


(5.3.1) 
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T 

“  m0 
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K 

t  =0  Az 

Define  the  deviation  from  the  integral  manifold  (r  ,  =  L  (x  ,\x)  of  the  closed-loop 

optimal  system  (5.3.1)  by 


xvi  LvJ_  i^E  v».  ysw 
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x.  -L  X, 


(5.3.2) 


It  is  easy  to  see  that  with  (5.3.2),  (5.3.1)  is  equivalent  to  the  following  block  triangular  sys¬ 
tem: 


X 

X 

K 

Fu  +  F l2  L  Fn 

K 

ef) 

0  F 22  —  €  L  F  j2 

V 

aJ 

(5.3.3) 


Uo  K 


The  optimal  control  (5.2.6.a)  in  this  new  state  space  is 

u  =  —  R  1  (B  j  Xx  +  B2  (A.^  +  L2lx  +  L22Xx)) 

-  —R~l  (B  2L  2\X  +(B1  +  B2L22)Xx)~  R~1B2X7)  =  u'm  +  u'v  .  (5.3.4) 

The  optimal  control  consists  of  two  components,  namely  uSI  and  uv  .  The  fast  control, 
u  =  —R~lB2\Tj  ,  governs  the  action  of  the  deviation  from  the  manifold  and  vanishes  as  the 
optimal  system  is  on  the  integral  manifold.  Clearly,  the  optimality  conditions  (5.3.3)  and  the 
optimal  control  (5.3.4)  become  identical  with  (5.2.24)-(5.2.26)  when  the  optimal  system  starts 
with  its  conditions  on  the  manifold  or  somehow  converges  to  the  manifold  eventually.  We 
have  a  decoupled  subsystem  (t)  .  X^)1  from  the  optimality  conditions  together  with  the  fast 
control 


=  (F,,  —  6  LF ,,) 


V 

V 

0 

V 

An 

An 

r  =  0 

X° 

An 

*2v 


(5.3.5) 
(5.3.6.  a) 


Note  that  (5.3.5)  is  an  O  (e)  perturbed  version  of  the  following  optimality  condition: 

€T)  T)  ^  22  2^  ^2  T)  T)  7)° 

€Ar,  —S  —A  22  \  ^“0  ,  S  0 

(5.3.6)  corresponds  to  the  following  optimal  problem: 


(5.3.6.b) 
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•ss 


67)  =  /I  22  7)  +  5  ,  U  „ 

CO 

A/tn  ,  Min  1  r 

u  J'=  u  t/715  ^  +  UVR  “ndt 

'  71  2  o 

7}(0)  =  7)°  ,  77(00)  /ree  . 

For  this  optimal  problem  to  have  a  unique  optimal  solution,  we  propose  the  following  assump¬ 
tion.  A  detailed  proof  can  be  found  on  P.237-238  in  [32]. 

Assumption  5.3.1. 

(A  ;,2 . 5,  .  5  )  is  a  stabilizable-detectable  triple. 

It  is  easy  to  see  from  the  block  triangular  system  matrix  in  (5.3.3)  that  the  decoupled 
fast  subsystem  (5.3.5)  has  2m  fast  eigenvalues  with  order  (9(1/6).  Among  these  eigenvalues, 
m  of  these  eigenvalues  are  symmetric  to  the  other  m  eigenvalues  with  respect  to  the  origin. 
Recalling  the  nonsingularity  assumption  on  F  ,2  and  the  smallness  of  €  ,  it  can  be  similarly 
shown,  as  in  Theorem  5.2.1.  that  (5.3.5)-(5.3.6.a)  correspond  to  the  following  optimal  prob- 


67)  =  A  22  7}  +  B2  uv  (5.3.7.a) 

00 

Min  _  Min  1  p  •  • 

u  Jt>=  u  tJ  7^S‘.TI  +  Ur]  (5.3.7.b) 

u  7)  U  T)  2  0 

7)(0)  =  7)°  .  7}(oo)  free 


where 


(A  22  ,B2  .  S(  .  F()  =  (A2:  .  B2  ,S  .R)  +  0(e) 
and  its  unique  existence  is  guaranteed. 

When  the  closed-loop  optimal  system  (5.2.22)  starts  on  the  manifold,  i.  e..  7)°  =  0  .  we  have 
the  following  by  inspection  on  (5.3.7): 

uv(t)  =  0  .  t  >  0  . 

With  this  observation  we  are  again  justified  that  the  full-order  optimal  problem  (5.2. 1  )-(5.2.2) 
is  equivalent  to  a  lower  order  one.  viz.  (5.2.21).  From  standard  textbooks  on  optimal  con- 
trol[31.  32]  it  is  understood  that  a  unique  optimal  solution  to  the  fast  subproblem  (5.3.7 ) 


exists  provided  {A  22  .  S4)  is  stabilizable-detectable.  This  condition  is  equivalent  to 

(.4  22.52.S)  being  stabilizable-detectable  by  a  singular  perturbation  argument  similar  to 
[33],  Due  to  the  presence  of  e  in  the  state  equation  (5.3.7.a).  the  closed-loop  fast  subsystem 
tends  to  zero  at  the  rate  of  0(  1/e)  .  In  other  words,  this  means  that  the  trajectory  of  the 
full-order  optimal  system  (5.2.l)-(5.2.2)  will  converge  to  the  integral  manifold  at  the  rate  of 
0  (l/e)  and  then  flow  along  it  slowly  as  its  lower  order  counterpart  described  by  (5.2.21). 

To  see  how  significant  the  deviation  from  the  manifold  contributes  to  the  overall  cost,  we 
look  at  the  Hamiltonian-Jacobian  Equations  of  (5.2.1  )-(5.2.2)  with  the  standard  assumption 
that  J  (x  ,  z  .  t  )  is  continuously  differentiable  on  the  relevant  domain. 

1  A/'  .  &J  1 

0  =  —  (x  Qx  +  i  Sz  +  u  Ru)  +  ( - )  ( A  nx  +  A  nz  +  B  ru  )  +  ( - )(zl  21x  +  A  22z  +  B  2u  )  — 

2  Qx  Qz  € 

It  is  pointed  out  on  p.  355  of  [31]  that  the  costates  (Xx  .  X2 )  are  such  that 

a/  -  a/‘ 

K  •  —  .  K  =  — 

d*  Qz 

when  evaluated  along  the  optimal  system  ( u  (t  )  ,  x  (t)  ,  :  (f  ))  . 

Consequently. 

J  =  x\x  +  z  k. 
k. 

Recall  the  scaled  costate  variable  kz  =  —  that  we  have  been  using  in  the  optimality  condi- 

€ 

tions  and  the  optimal  controls,  the  optimal  cost  can  be  rewritten  as 

J  =  x  kx  +  ez  k.  . 

Expressing  this  cost  by  the  slow  state  variable  (x  .  kx)  and  the  deviation  from  the  integral 
manifold  (tj  .  kv)  ,  we  have 

J  =  x  kx  +  €  (t)  +  L  jjX  +  L  )  (Xn  +  L  21x  +  L  -^X,  ) 

=  x  X,  +  €  (L  nx  +  L  12X,  )  ( L  21x  +  L  22Xx )  +  €  ( (L  ux  +  L  12Xx  )k^  +  tj  (L  21x  +  L22kx  )  +  r)k, 
=  A;(x  ,Xx)  +  €7T)(x  ,  Xx  .rj,kv). 

Note  that  7^=0  for  (t)  .  kv)r  =  0  and  it  weighs  only  O  (e)  in  the  overall  optimal  cost  J 


We  now  illustrate  the  idea  of  decomposing  optimal  systems  by  integral  manifold  with 


the  following  example. 

Example  5.3.1 


x  =  a  x  +  b  z 
ez  =  —z  +  u 


(5.3.8.a) 
(5.3.8. b) 
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t  =0 
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z  . 

/  ree 


.  *>0.Q.S»o 

U  U  •)  J 

Z  0 

a.  b.  Q.  S.  and  R  are  scalars  and  0  <  e  «  1  . 

Equation  (5.3.8)  is  of  an  actuator  form  which  is  common  in  practice. 

When  €  =  0  we  obtain  a  reduced  optimal  problem 

x  -  a  x  +  b  u  x  (0)  =  x°  .  x  (oo)  =  free 

oo 

Min  ,  Min  1 

o 


(5.3.8.c) 


J  =  ""  -  f  Qx2  +  (5  +  R)u2  dt 
u  u  2 


(5.3.9.a) 

(5.3.9.b) 


z  —  u  . 


Its  Hamiltonian  is  given  by 


1 


H  =  —  (Q  x  +  (S  +  R)u  )  +  X(a  x  +b  u) 
2 


Necessary  conditions  for  optimality  are 


—  =  b\+(S+R)u  =0 

a* 


whence 


-b 


u  — 


(S  +  R) 

BH 

X  = - =  -a  X  -  Qx 

a* 


sr 
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ft 
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Thus. 


107 


\x  1  S  +  R  lx 


l\l  H2  -a  MX] 
x(o)  =  M  .  x(D  =  o. 

When  e  ^  0  ,  the  Hamiltonian  equation  for  (5.3.8)  is 

H  =  —  (Q  x2  +  S  z2  +  R  u2)  +  \x  (a  x  +b  z)  +  \z(u 
2 

X, 

where  Xz  =  —  is  the  scaled  costate  of  the  original  costate  variable  Xz  . 
e 

Optimality  conditions  are 

QH  .  .  K 

- =  X,  +  R  u  =0  ,  u  = - 


\x  = - =  —  a  \x  —  Qx 

Qx 


Az  = - =  -b\x  -Sx  +  Xz  . 


Hence 


,  a  0  b  0 
—Q  —a  0  0 


0  0-1 


R  lX 


0  —b  —S  1 


[Ml 


K  21  F  22 


F  22  = 


1 

1 - 

R 


is  nonsingular  since  detC/M,)  =  —(1  +  — )  ^  0  . 
5  1  1  £ 


Thus.  (5.3.10)  has  an  integral  manifold 


(5.3.10) 


i 
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where  £  €  R~  “satisfies 
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R  [0  0 


£*— ■  F»f»-Ls  ,1  [0-t| 

It  is  easy  to  see  by  applying  the  [.'Hospital's  rule  that 


-b 

S  +  R 
bR 

S  +  R 


lim  T  _  ~b 
,  _  n  L  12  ~ 

€  0  S  +  R 


L  12  = 


L  ->•>  — 


a(€)  +  0(e) 

y(e) 


lim  _  lim  _ 
t  -*  QL  n  ~  t  -*  0L  22  ~  ® 


e  ~ *  0  S+i?  €  — ♦  0  11  e  -»  0  " 

With  a  little  elfort  everyone  can  see  immediately  that  the  scalar  optimal  problem 


x  -  afx  +  b(u 


Min  Min  1  r  _  2  „  ? 

u  u  -JQ<X  +2C(xu  +  R(u  dt 


(5.3.12.a) 
(5.3. 12. b) 


x  (0)  =  x  .  x(oo)  /ree 


has  the  optimality  conditions 


«€ 
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X 
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K2.+ - («, - ) 


and  optimal  control 


M...  W 


u  - - (C  rr  +  b  e\  (  )  . 

R. 


If  this  optimal  problem  is  to  be  the  lower  order  equivalent  of  the  full-ord«.r  optimal  system 
(5.3.8)  on  the  manifold,  it  is  necessary  that  we  have 
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a  bL  12 


l— Q  —a 


(5.3.l3.a) 


c;  b(cf 

~Q(  +  -  ~(ae  -  — ) 


-  —  =  ~ZQL  12 
R  a 


(5.3. 13. b) 


- =  (1  —  ea  )  L  j, 

R. 


(5.3.13.c) 


Solving  (5.3.13)  we  have 


a  =  a  + 


eQbL  j. 


(1  —  ea  ) 


(1  —  ea  ) 


2e  =  <2  - 


€  Q  12 


(1  -6a)2 


R=  — 


(1  -taf  L 


C  =  — 


(1  -  ear 

Therefore,  the  optimal  control  problem  (5.3.8)  is  equivalent  to  the  lower  order  optimal  prob¬ 


lem  (5.3.12)  with  the  above  coefficients.  Note  that  (a t  .  b 6  .  Q€  ,  R €)  reduces  to 


(a  .5  ,  Q  ,  (S  +  R  ))  while  C(  vanishes  at  e  =  0  .  This  shows  that  the  equivalent  lower  order 


optimal  problem  (5.3.12)  becomes  the  reduced  problem  (5.3.9)  when  6  =  0.  To  construct  the 


optimal  subproblem  that  governs  the  deviation  from  the  manifold,  we  introduce 


as  the  deviation  from  the  manifold. 


Ill 


With  this  it  is  easy  to  see  from  (5.3.5M5.3.7)  that 


eri 

1 

R  7) 

■ — (S  +  sbL  21)  1  A 


'h  =o 


“r,  =  — 


which  corresponds  to  the  optimal  subproblem 

er)  =  -7)  +  a, 


Min  „  Min  1  /»  .  ,  .  .  2  „  2 

„  „  ~  f  (S  +ebL2l)-r)  +  R  dt 


ur  2 


(5.3.14.a) 

(5.3.14.b) 


T)(0)  =  rj  .  7)(oo)  free 
The  stabilizing  optimal  control  gives 


€7)  =  -  (1  +  — )t?  .  T)(0)  =  7]° 

R  . 


where  K  >  0  satisfies  the  algebraic  Riccati  equation 


K  -  (S  +  tbL,,)  =  -AT  (l  +  — )  . 


Thus,  rj  (c  )  —  0  at  the  rate  of  0(  1/e)  .  For  the  case  where  the  in  tial  conditions  (x°  ,  z°)r  do 
not  lie  on  the  manifold,  the  optimal  system  will  converge  to  its  lower  order  equivalent  at  the 
rate  of  0( l/«)  ,  and  the  behavior  of  the  deviation  is  governed  by  the  optimal  subproblem 
(5.3.14).  As  a  whole.  we  have  shown  that 


x  =  a  x  +  b  z 


ez  =  — z  +  u 
(  01  [ 


Min  Min  1  r  2  2  ?  ^ 

J=  ~  I  Qx  +  Sz  +  Ru  dt  .  R  >  0  ,  Q  ,  S  ^  0 
u  u  2 


is  equivalent  to  the  lower  order  optimal  problem 
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x  =  c  t  x  +  b  (  u 

oo 

Min  Min  1  r  ■>  ■> 

/  =  —  /  Q,x‘  +  2C,xu  +R.u~dt 

u  u  2  J 

x(0)  =  x°  ,  x(oo)  /ree 
if  (x°  .  z°)r  belongs  to  a  manifold. 

•  Complete  separation  into  two  subproblems 

So  far  we  have  seen  how  a  decoupled  optimal  subproblem  concerning  the  deviation  from 
the  manifold  is  formulated  when  the  initial  conditions  of  the  full-order  optimal  system  do  not 
start  on  the  integral  manifold.  To  get  a  complete  separation  of  the  original  optimal  problem 
into  two  subproblems,  one  slow  and  one  fast,  we  need  to  block  diagonalize  the  block  triangular 
matrix  in  (5.3.3). 

Introduce 


f 

X 

1 

X 

H  yx  H  12 

V 

AJ  = 

K 

-eH 

K 

=  K 

-  e 

*21  *22 

Differentiate  both  sides  with  respect  to  t 


X 

V 

— 

-eH 

K 

=  (Fn  +  F12L)[  +  eH  }  +  f12  ,  -H{F.2-eLF ,,)  . 

*6  N 


=  (Fn  +  F  l2L  )  +  \e(Fn  + Fl2L)H  +  Fl2-H(F22-eLFl2)  . 

Ki  1  Ki 

Now  choose  H.  which  satisfies 

e(Fn  +  FnL)H  +  Fl2-H(F22-eLFl2)  =  0 
By  the  implicit  function  Theorem,  a  unique  solution  H  €  R2"  *  2m  to  the  above  equation  of  the 


1 

':4 


H  =  Fl2F22  +  O  (e) 

exists  for  F 22  being  nonsingular  and  e  small  enough.  With  this  new  state  variable  we  have  the 


4 

%} 

r 


1  ollowing: 


=  (FU  +F12L) 


i 

i 

t 

• 

it 

o 

1! 

i° 

(5.3.15) 


€7)  T) 

=  (F22-eLFl2 ) 


(5.3.16) 


u  =  us(£  .  Xg)  +  a*  (t)  .  X,,) 

where  the  optimal  control  u  from  (5.2.6.a)  m  this  state  space  consists  of  two  components. 


namelv 


u‘($.ki)  =  -R  l(B2L21$  +  {Bl  +  52Z.22)A£) 


(5.3.17) 


uf(r)  .\v)  =  -R~lB2Kv  (5.3.18) 

+  eR  _1  (  B  2L  21(HnT)  +  H  12\v)  +  (B  ,  +S21 22)  (H217)  +  H  22A„) )  . 
Comparing  (5.3.15)  and  (  5.3.17)  with  (5.2.24)  and  (5.2.26).  we  know  at  once  that  the  follow¬ 


ing  optimal  problem  would  have  optimality  conditions  and  optimal  control  as  (5.3.15)  and 
(5.3.17)  respectively. 


•  Slow  subproblem 


t  =  Aj  +  Btus 


Min  Min  1  r  „ 

u  =  ~  J  £  Qtt  +  U,CJ  +  us  R(us  dt 

US  US  2 


(5.3. 19. a) 
(5.2.21.b) 


£(0)  =  £  .  |(oo)  free 

where  (A  t  ,  B f  ,  Ce  ,  Qt  .  R()  are  as  in  (5.2.28)-(5.2.32).  In  the  same  manner.  (5.3.16)  is  simi¬ 
lar  to  (5.3.5)  whereas  (5.3.18)  is  a  perturbation  of  (5.3.6).  Thus  we  have 

•  Fast  subproblem 


€T)  =  A  22  7)  +  B2  U, 


Min  Min  l  r  ~  ■  ~ 

„  Jt  =  „  ~  J  VS'V  +  u,  Rtuf  dt 


(5. 3. 20. a) 
(5.3.20.b) 
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r)(0)  =  TjV  .  T)(  oo  )  f  ree 


where 


(A  22  ■  B2  ■  S(,R()  =  (A22.B2.S  ,  R  )  +  0(e) 
Both  subproblems  exist  and  are  unique. 


The  transformation 


is  invertible  and  is  expressed  by 


/  +  6 HL  -eH  K 
-L  I 


(5.3.22) 


With  (5.3.22)  we  have  decomposed  the  full-order  optimal  problem  (5.2.1 )-( 5.2.2)  into  two 
decoupled  optimal  subproblems,  one  slow  and  one  fast.  This  is  an  exact  decoupling  and  relies 
on  the  nonsingularity  assumption  of  F 22  and  the  smallness  of  6  .  Instead  of  solving  the 
(m  +  n)th  order  optimal  problem  (5.2.21 )— ( 5.2.22).  we  can  solve  with  ease  the  two  lower 
order  subproblems.  (5.3.19)  and  (5.3.20). 


•  Optimal  problems  over  a  large  time  interval  with  prescribed  end  states 

We  now  consider  the  optimal  problem  of  the  following  singularly  perturbed  system: 


X 

I 

eH 

s 

— 

(5.3.21) 

:  L 

I  +  6  LH  7) 

k* 

A. 

k 

V* 

x  A  1 1  A  12  x 

*1 

= 

+ 

_  u  x€ R"  .z £Rm  .  u €Rr 

(5.3.23) 

e:  A2X  A22  z 

i 

Min  Min 

1 

r 

r  ■  _  * 

(5.3.24) 

J  = 

u  u 

2J. 

f  x  Qx  4 -  z  Sz  +  u  Ru  dt 

> 

K 

with  the  same  description  as  in  (5.2.l)-(5.2.2). 

First  of  all  we  note  that  (5.3.23)  is  identical  to  (5.2.1),  and  (5.2.24)  differs  from  (5.2.2)  in 


that  the  terminal  time  is  not  infinity  but  T.  Also,  since  the  trajectory  is  required  to  reach  a 
specified  point,  the  final  state  conditions  are  no  longer  free 

We  shall  be  concerned  with  T  being  large  and  seek  an  approximate  scheme  to  decompose  our 
optimal  problems. 

It  was  shown  in  a  recent  paper  [34]  that  an  approximate  solution  to  problems  of  optimal  con¬ 
trol  over  a  large  time  interval  with  end  states  prescribed 

x  =  Fx  +  Gu  x  (0)  ,  x  (T  )  prescribed  (5. 3. 25. a) 

r 

Min  .  Min  1  r  •  „ 

J  -  —  x  Qx  +  u  Ru  dt  (5.3.25.b) 

u  u  J 

z  0 

R  >  0  .  Q  >  0  .  a  nd{  F  .y/Q  }  is  completely  observable 
can  be  obtained  by  piecing  together  the  optimal  trajectory  and  control  of  the  two  infinite  time 

problems 


dx 

x  =  -  =  Fx  +  Gu 

dt 


(5. 3. 26. a) 


Min  „  _  Min 
u'  u 


—  f  x  Qx~  +  u~  Ru~  dt 
2  , 


x*(0)  =  x(0)  .  .r"(°°)  free 


(5. 3.26.b) 


dx 

-  =  Fx  +  Gu  (5. 3. 27. a) 

ds 

OO 

Min  .  Min  1  r 

J  —  —  x  Qx  +  u  Ru  ds  (5.3.27.b) 

U  u  2 

o 


x  (0)  =  x(n  .  x  (oo)  free  . 

In  other  words,  the  solution  of  a  fixed  end-point  optimal  control  problem  can  be  approximated 
by  superposition  of  two  regulator  problems. 
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One  easy  way  of  piecing  is 

.t  **(r  )  0  ^  t  ^  tm 

x  ’(T  -t)  ‘n,  <  [  ^  T 

•  • 

where  tm  is  defined  to  be  the  time  where  the  two  curves  meet,  ie  x  *  (tm  )  =  x  (T  —  tm)  . 
Furthermore. 

Min  ,  Min  ,  Min  . .  . 

j  -  (  .  y  )  +  (  y  ) 

u  u  u 

the  sum  of  the  cost  of  the  two  regulator  problems  approaches  that  of  the  fixed  end-point  prob¬ 
lem  (5.3.25)  as  T  — *  °o  . 

Equation  (5.3.27)  can  be  viewed  as  a  regulator  system  in  reverse  time,  while  (5.3.26)  is  a  regu¬ 
lator  system  in  forward  time. 

Applying  this  scheme  to  our  fixed  end-point,  linear-quadratic  regulator  problem 
(5.3.23M5.3.24),  we  have  the  forward  regulator  formulated  as 


x  ‘4 11 

A  12  X  * 

ez~  ^21 

^  22  -- 

Min 

Min  1 

_  J 

=  — 

u 

k*  2 

J  x  Qx  +  Si  +  u~  Ru~  dt 


(5.3.28) 


0 

_ 

X 

X 

X 

— 

0 

• 

i  -  0 

* 

which  is  equivalent  to  the  Allowing  lower  order  optimal  problem  when  the  initial  conditions 
belong  to  a  manifold. 


xe  =  A  e  x  e  +  5  e  ue 


Min  .  .  Min  1 


A  = 


2 


f  x~  Q(  xf  +  u{*  Ct  x4  +u~  R~  u~  dt 


x  t  (0)  =  x  ,  x~  (oo)  free 

and  the  deviation  from  the  manifold  is  an  independent  optimal  problem  described  by 
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er)‘  =  .4  2,  T)  +  B  2  U„' 


.V/tn  ,  .  Aft'n  1  /•  .  ■  . 

.  J  -r  =  .  —  V  S  e  Tj  +  u  R  t  u  dt 

u  u  l  J  ' 

1  T)  ^  O 


(5.3.29) 


7}'(0)=7)a~  .  7)*(oo)  free  . 

The  reverse  regulator  problem  can  be  similarly  defined  and  decomposed. 

Overall,  we  propose  the  following  approximate  optimal  control  solution  to  the  fixed  end¬ 
point  optimal  problem  (5.3.25)  by  composing  the  solutions  of  several  lower  optimal  problems 


u  (r  )  =  u  ~{t  )  +  u  \T  —  t  )  +  u  At  )  +  u  (T  —  t  ) 

T)  T) 

By  the  above  analysis,  we  can  picture  the  optimal  trajectory  of  the  fixed  end-point  optimal 
problem  as  shown  in  Figure  5.1.  The  trajectory  converges  to  a  manifold  asymptotically  and 
then  flow  along  it  until  it  approaches  the  vicinity  of  the  terminal  time,  where  it  leaves  the 
manifold  and  goes  to  the  designated  end  states.  It  is  u  ^  that  brings  the  optimal  trajectory  to 

the  manifold.  On  the  other  hand,  u  is  responsible  for  steering  the  trajectory  away  from  the 
manifold  and  going  to  the  prescribed  final  points. 
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6.  CONCLUSIONS 


[  We  have  presented  the  necessary  and  sufficient  conditions  for  the  existence  of  the  integral 

manifold  in  linear  systems.  It  has  been  shown  that  in  linear  systems  there  exists  a  family  of 
input  dependent  integral  manifolds  if  the  existence  of  the  manifold  is  assured  in  the  zero  input 
|  case.  The  relationship  between  them  is  also  given.  Emphasis  is  given,  though  not  exclusively, 

to  singularly  perturbed  systems.  A  two-stage  design  in  the  eigenvalue  placement  problem 
clearly  illustrates  the  usefulness  of  the  integral  manifold  approach  in  reducing  the  computa¬ 
tional  complexity  and  a  way  to  obtain  an  approximate  solution  in  the  singularly  perturbed 
systems.  The  effect  of  parasitics  on  the  nominal  states  of  the  singularly  perturbed  systems  can 
be  taken  into  account  by  using  the  manifold  idea.  This  allows  us  to  design  a  controller  to 
achieve  the  tracking  objective  to  any  order  of  accuracy  in  such  systems.  All  of  these  results 
are  described  in  Chapter  2. 

In  Chapter  3  we  applied  our  results  to  the  control-problem  of  flexible  link  manipulators. 
The  nonlinear  system  in  this  case  was  shown  to  be  a  perturbed  version  of  a  linear  time- 
invariant  system.  The  unsatisfactory  performance  of  flexible  robots  at  high-frequency 
maneuvers  is  explained  by  the  fact  that  the  presence  of  neglected  flexibility  causes  a  phase 
delay  in  the  system  output.  Time  domain  analysis  using  the  integral  manifold  approach  pro¬ 
vides  a  corrective  scheme  which  coincides  with  that  based  on  the  frequency  domain  analysis. 
However,  in  a  more  general  model  where  the  Laplace  transform  is  not  applicable  due  to  non¬ 
linearity  or  time-varying  characteristics  in  the  system,  the  integral  manifold  approach  is  still 
applicable  and  offers  a  solution  in  controller  design.  To  extend  our  idea  to  the  flexible  joint 
manipulators,  we  studied  the  effect  of  a  flexible  connection  in  an  interconnected  mechanical 
system  which  also  includes  the  flexible  joint  robot  model  as  one  of  its  kind.  The  flexible  sys¬ 
tem  has  a  displaced  center  of  mass  with  respect  to  that  of  the  rigidly  connected  one.  The  flexi¬ 
bility  also  induces  a  perturbed  natural  frequency  and  a  perturbed  damping  ratio. 


We  focused  on  the  problem  of  tracking  and  disturbance  rejection  in  the  nonlinear  system 
in  Chapter  4.  For  a  class  of  linear  equivalent  nonlinear  system,  linearizing  and  stabilizing  the 
nonlinear  system  render  an  integral  manifold  globally  attractive.  Based  on  this  observation, 
we  designed  a  slowly  varying  integral  control  that  drives  the  system  along  the  manifold  to  its 
equilibrium  where  the  tracking  error  becomes  zero.  Regardless  of  initial  conditions,  asymp¬ 
totic  tracking  and  disturbance  rejection  of  slowly  varying  signals  can  be  achieved  due  to  the 
global  attractivity  of  the  manifold. 

It  is  known[35]  that  the  optimal  trajectory  of  a  long-range  flight  consists  of  steep  ascend¬ 
ing  to  a  manifold,  cruising  along  it  with  a  fairly  constant  altitude,  and  finally  descending  to 
the  destination.  This  is  precisely  a  typical  optimal  trajectory  of  a  singularly  perturbed  sys¬ 
tem.  This  leads  to  the  analysis  in  Chapter  5.  When  the  initial  conditions  are  restricted  to  a 
manifold,  the  optimal  problem  of  a  singularly  perturbed  linear  system  with  quadratic  cost 
functional  is  shown  to  be  equivalent  to  a  lower  order  one.  Regulation  problems  as  well  as 
optimal  problems  over  a  large  time  interval  with  prescribed  end  states  are  both  studied. 

The  tracking  problem  for  flexible  link  robots  can  be  viewed  as  controlling  the  robot  tra¬ 
jectory  to  a  prescribed  attractive  manifold.  This  is  certainly  one  of  the  future  research  areas. 
Among  other  prominent  research  issues,  the  minimum-time-to-climb  problem  in  aerodynamics 
falls  into  the  category  of  the  singularly  perturbed  optimal  system  with  constraints.  An  exten¬ 
sion  of  ideas  in  Chapter  5  should  be  done  to  solve  this  well-known  problem. 

We  have  shown  the  use  of  the  integral  manifold  in  system  designs  through  the  limited 
scope  of  this  thesis.  Extension  of  these  ideas  to  other  areas  of  system  and  control  will 
definitely  be  a  future  work  with  a  unified  theory  and  with  countless  applications. 
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Figure  4-2  External  feedback  linearized  system  with  nonlinear  output. 


I 


137 


VITA 


Huan-chi  Chris  Tseng  was  born  in  Taiwan.  Republic  of  China,  on  August  2.  1957.  He 
received  his  B.S.  degree  in  Electrical  Engineering  from  National  Taiwan  University  in  June 
1982.  He  received  his  M.S.  degree  in  Mathematics,  specializing  in  optimization  and  computa¬ 
tion,  in  May  1985  from  the  University  of  Illinois  at  Urbana-Champaign.  Since  January  1985, 
he  has  been  a  research  assistant  in  the  Coordinated  Science  Laboratory  at  the  University  of  Illi¬ 
nois.  His  research  interests  are  in  the  areas  of  nonlinear  systems,  robotic  control,  optimal  con¬ 
trol.  system  modeling,  and  singular  perturbation. 


